By type
Project Build Version: 1.0.0 2021-07-06 22:58:57.434 INFO --- [ main] org.onap.aai.util.AAIConfig : Initializing AAIConfig 2021-07-06 22:58:57.442 DEBUG --- [ main] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-graphadmin/./resources/etc/appprops/aaiconfig.properties 2021-07-06 22:58:57.442 INFO --- [ main] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-graphadmin/./resources/etc/appprops/aaiconfig.properties 2021-07-06 22:58:57.445 INFO --- [ main] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename 2021-07-06 22:58:59.297 WARN 1 --- [ main] o.s.b.l.logback.LogbackLoggingSystem : Ignoring 'logback.configurationFile' system property. Please use 'logging.config' instead. . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v2.1.12.RELEASE) 2021-07-06 22:58:59.991 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : Starting GraphAdminApp on aai-graphadmin with PID 1 (/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar started by aaiadmin in /opt/app/aai-graphadmin) 2021-07-06 22:58:59.991 DEBUG 1 --- [ main] org.onap.aai.GraphAdminApp : Running with Spring Boot v2.1.12.RELEASE, Spring v5.1.13.RELEASE 2021-07-06 22:58:59.992 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : The following profiles are active: dmaap,one-way-ssl 22:59:04,744 |-INFO in LogbackRequestLog - Will use configuration resource [/localhost-access-logback.xml] 22:59:04,758 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - debug attribute not set 22:59:04,758 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 22:59:04,758 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS] 22:59:04,759 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1426963578 - No compression will be used 22:59:04,760 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1426963578 - Will use the pattern /opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd} for the active file 22:59:04,760 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - The date pattern is 'yyyy-MM-dd' from file name pattern '/opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd}'. 22:59:04,760 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Roll-over at midnight. 22:59:04,760 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Setting initial period to Tue Jul 06 22:59:04 GMT 2021 22:59:04,797 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - Active log file name: /opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log 22:59:04,797 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - File property is set to [/opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log] 22:59:04,797 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS] to null 22:59:04,797 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - End of configuration. 22:59:04,797 |-INFO in ch.qos.logback.access.joran.JoranConfigurator@21282ed8 - Registering current configuration as safe fallback point 2021-07-06 22:59:05.025 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/lib/aai-els-onap-logging-1.8.1.jar!/ 2021-07-06 22:59:05.093 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 68 ms to scan 1 urls, producing 6 keys and 6 values 2021-07-06 22:59:05.098 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/classes!/ 2021-07-06 22:59:05.115 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 16 ms to scan 1 urls, producing 7 keys and 53 values 2021-07-06 22:59:05.149 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/lib/aai-els-onap-logging-1.8.1.jar!/ 2021-07-06 22:59:05.154 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 5 ms to scan 1 urls, producing 6 keys and 6 values 2021-07-06 22:59:05.160 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/classes!/ 2021-07-06 22:59:05.174 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 14 ms to scan 1 urls, producing 7 keys and 53 values 2021-07-06 22:59:05.182 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/lib/aai-els-onap-logging-1.8.1.jar!/ 2021-07-06 22:59:05.191 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 9 ms to scan 1 urls, producing 6 keys and 6 values 2021-07-06 22:59:05.196 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/classes!/ 2021-07-06 22:59:05.210 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 14 ms to scan 1 urls, producing 7 keys and 53 values 2021-07-06 22:59:05.638 INFO 1 --- [ main] org.onap.aai.config.NodesConfiguration : Translator is SchemaServiceTranslator 2021-07-06 22:59:06.129 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:06.129 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:06.129 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:06.130 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:06.140 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/versions, BODY= 2021-07-06 22:59:06.448 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:06.448 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:06.449 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:06.449 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:06.766 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:06.897 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Processing the translator 2021-07-06 22:59:06.898 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv11 2021-07-06 22:59:06.899 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:07.007 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:07.007 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:07.007 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:07.007 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:07.073 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:07.135 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:07.135 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:07.135 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:10.214 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 222 2021-07-06 22:59:10.242 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv12 2021-07-06 22:59:10.243 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:10.245 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:10.245 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:10.245 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:10.245 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:10.265 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:10.300 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:10.301 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:10.301 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:11.523 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 235 2021-07-06 22:59:11.536 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv13 2021-07-06 22:59:11.536 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:11.538 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:11.538 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:11.538 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:11.538 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:11.559 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:11.596 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:11.597 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:11.597 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:12.925 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 237 2021-07-06 22:59:12.941 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv14 2021-07-06 22:59:12.941 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:12.949 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:12.949 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:12.949 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:12.949 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:12.965 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:12.997 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:12.998 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:12.998 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:14.679 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 272 2021-07-06 22:59:14.691 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv15 2021-07-06 22:59:14.692 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:14.693 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:14.693 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:14.693 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:14.693 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:14.743 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:14.759 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:14.759 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:14.759 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:15.976 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 279 2021-07-06 22:59:15.991 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv16 2021-07-06 22:59:15.991 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:15.993 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:15.993 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:15.993 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:15.993 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:16.014 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:16.030 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:16.031 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:16.031 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:17.594 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281 2021-07-06 22:59:17.604 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv17 2021-07-06 22:59:17.604 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:17.606 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:17.606 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:17.606 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:17.606 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:17.626 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:17.642 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:17.642 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:17.642 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:18.957 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281 2021-07-06 22:59:18.995 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv18 2021-07-06 22:59:18.996 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:18.998 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:18.998 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:18.998 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:18.998 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:19.047 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:19.063 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:19.063 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:19.064 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:20.699 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281 2021-07-06 22:59:20.709 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv19 2021-07-06 22:59:20.710 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:20.711 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:20.712 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:20.712 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:20.712 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:20.728 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:20.754 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:20.755 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:20.756 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:22.032 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 301 2021-07-06 22:59:22.043 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv20 2021-07-06 22:59:22.043 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:22.045 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:22.045 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:22.045 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:22.045 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:22.063 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:22.108 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:22.109 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:22.109 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:23.730 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 305 2021-07-06 22:59:23.741 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv21 2021-07-06 22:59:23.742 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:23.744 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:23.744 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:23.744 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:23.744 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:23.771 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:23.796 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:23.796 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:23.797 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:25.385 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 371 2021-07-06 22:59:25.401 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv22 2021-07-06 22:59:25.401 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:25.404 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:25.404 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:25.404 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:25.404 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:25.435 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:25.468 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:25.469 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:25.469 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:27.103 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378 2021-07-06 22:59:27.117 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv23 2021-07-06 22:59:27.118 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-06 22:59:27.120 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:27.120 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:27.120 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:27.120 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:27.198 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:27.226 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:27.226 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-06 22:59:27.340 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-06 22:59:28.980 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378 2021-07-06 22:59:29.119 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.119 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.119 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.122 INFO 1 --- [ main] o.onap.aai.rest.client.ApertureService : Successfully initialized the aperture service 2021-07-06 22:59:29.301 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Processing the translator 2021-07-06 22:59:29.302 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv11 2021-07-06 22:59:29.302 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.303 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v11, BODY= 2021-07-06 22:59:29.305 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.305 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.305 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.305 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.319 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.321 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.321 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.322 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv12 2021-07-06 22:59:29.322 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.323 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v12, BODY= 2021-07-06 22:59:29.324 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.324 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.324 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.324 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.333 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.335 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.336 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.336 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv13 2021-07-06 22:59:29.336 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.337 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v13, BODY= 2021-07-06 22:59:29.338 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.338 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.338 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.338 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.355 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.358 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.358 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.359 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv14 2021-07-06 22:59:29.359 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.359 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v14, BODY= 2021-07-06 22:59:29.361 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.361 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.361 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.361 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.371 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.374 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.374 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.375 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv15 2021-07-06 22:59:29.375 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.376 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v15, BODY= 2021-07-06 22:59:29.377 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.377 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.377 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.377 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.388 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.391 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.392 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.392 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv16 2021-07-06 22:59:29.392 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.393 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v16, BODY= 2021-07-06 22:59:29.394 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.394 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.394 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.394 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.408 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.411 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.411 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.412 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv17 2021-07-06 22:59:29.412 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.413 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v17, BODY= 2021-07-06 22:59:29.414 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.414 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.414 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.414 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.423 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.426 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.427 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.427 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv18 2021-07-06 22:59:29.428 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.428 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v18, BODY= 2021-07-06 22:59:29.429 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.429 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.430 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.430 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.444 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.447 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.448 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.448 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv19 2021-07-06 22:59:29.448 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.449 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v19, BODY= 2021-07-06 22:59:29.450 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.450 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.450 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.450 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.460 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.463 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.463 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.464 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv20 2021-07-06 22:59:29.464 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.464 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v20, BODY= 2021-07-06 22:59:29.465 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.465 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.465 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.465 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.480 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.483 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.483 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.483 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv21 2021-07-06 22:59:29.484 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.484 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v21, BODY= 2021-07-06 22:59:29.485 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.485 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.485 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.485 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.502 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.506 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.506 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.507 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv22 2021-07-06 22:59:29.507 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.507 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v22, BODY= 2021-07-06 22:59:29.508 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.508 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.508 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.508 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.523 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.527 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.527 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.528 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv23 2021-07-06 22:59:29.528 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-06 22:59:29.528 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v23, BODY= 2021-07-06 22:59:29.529 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-06 22:59:29.529 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-06 22:59:29.529 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-06 22:59:29.529 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-06 22:59:29.545 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-06 22:59:29.549 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-06 22:59:29.549 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-06 22:59:29.923 WARN 1 --- [ main] o.apache.activemq.broker.BrokerService : Memory Usage for the Broker (1024mb) is more than the maximum available for the JVM: 972 mb - resetting to 70% of maximum available: 680 mb 2021-07-06 22:59:31.195 INFO 1 --- [ main] com.datastax.driver.core : DataStax Java driver 3.6.0 for Apache Cassandra 2021-07-06 22:59:31.208 INFO 1 --- [ main] c.d.driver.core.GuavaCompatibility : Detected Guava >= 19 in the classpath, using modern compatibility layer 2021-07-06 22:59:31.209 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NEW_NODE_DELAY_SECONDS is undefined, using default value 1 2021-07-06 22:59:31.209 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NOTIF_LOCK_TIMEOUT_SECONDS is undefined, using default value 60 2021-07-06 22:59:31.264 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true 2021-07-06 22:59:31.568 INFO 1 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps. 2021-07-06 22:59:31.571 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NON_BLOCKING_EXECUTOR_SIZE is undefined, using default value 2 2021-07-06 22:59:31.656 WARN 1 --- [ main] .b.a.g.t.GroovyTemplateAutoConfiguration : Cannot find template location: classpath:/templates/ (please add some templates, check your Groovy configuration, or set spring.groovy.template.check-template-location=false) 2021-07-06 22:59:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 22:59:32.705 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 22:59:34.447 WARN 1 --- [ main] org.glassfish.jersey.internal.Errors : The following warnings have been detected: WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.onap.aai.rest.AuditSqlDbConsumer.executeAudit(java.lang.String,java.lang.String,javax.ws.rs.core.HttpHeaders,javax.ws.rs.core.UriInfo), should not consume any entity. 2021-07-06 22:59:34.761 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : Started GraphAdminApp in 36.991 seconds (JVM running for 38.879) 2021-07-06 22:59:34.764 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : Application 'aai-graphadmin' is running on 8449! 2021-07-06 22:59:35.101 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true 2021-07-06 22:59:35.101 INFO 1 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps. 2021-07-06 22:59:35.102 DEBUG 1 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.242.60.71:9042] 2021-07-06 22:59:35.145 DEBUG 1 --- [ main] i.n.u.i.logging.InternalLoggerFactory : Using SLF4J as the default logging framework 2021-07-06 22:59:35.226 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : -Dio.netty.noUnsafe: false 2021-07-06 22:59:35.226 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : Java version: 8 2021-07-06 22:59:35.229 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.theUnsafe: available 2021-07-06 22:59:35.230 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.copyMemory: available 2021-07-06 22:59:35.232 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Buffer.address: available 2021-07-06 22:59:35.234 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : direct buffer constructor: available 2021-07-06 22:59:35.235 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Bits.unaligned: available, true 2021-07-06 22:59:35.235 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9 2021-07-06 22:59:35.235 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.DirectByteBuffer.
(long, int): available 2021-07-06 22:59:35.235 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : sun.misc.Unsafe: available 2021-07-06 22:59:35.236 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.tmpdir: /tmp (java.io.tmpdir) 2021-07-06 22:59:35.236 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.bitMode: 64 (sun.arch.data.model) 2021-07-06 22:59:35.240 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.noPreferDirect: false 2021-07-06 22:59:35.240 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.maxDirectMemory: 1020067840 bytes 2021-07-06 22:59:35.240 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.uninitializedArrayAllocationThreshold: -1 2021-07-06 22:59:35.242 DEBUG 1 --- [ main] io.netty.util.internal.CleanerJava6 : java.nio.ByteBuffer.cleaner(): available 2021-07-06 22:59:35.258 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FORCE_NIO is undefined, using default value false 2021-07-06 22:59:35.267 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.workdir: /tmp (io.netty.tmpdir) 2021-07-06 22:59:35.274 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library 'netty_transport_native_epoll_x86_64', trying other loading mechanism. java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) at java.lang.Runtime.loadLibrary0(Runtime.java:870) at java.lang.System.loadLibrary(System.java:1122) at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:263) at java.security.AccessController.doPrivileged(Native Method) at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:255) at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:233) at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:124) at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287) at io.netty.channel.epoll.Native. (Native.java:69) at io.netty.channel.epoll.Epoll. (Epoll.java:33) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at com.datastax.driver.core.NettyUtil. (NettyUtil.java:57) at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95) at com.datastax.driver.core.Connection$Factory. (Connection.java:926) at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499) at com.datastax.driver.core.Cluster.init(Cluster.java:208) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355) at com.datastax.driver.core.Cluster.connect(Cluster.java:305) at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272) at org.janusgraph.diskstorage.cql.CQLStoreManager. (CQLStoreManager.java:165) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58) at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477) at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409) at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration. (GraphDatabaseConfiguration.java:1382) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113) at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:73) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:54) at org.onap.aai.dbmap.AAIGraph$Helper. (AAIGraph.java:80) at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94) at org.onap.aai.GraphAdminApp.main(GraphAdminApp.java:135) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:595) 2021-07-06 22:59:35.275 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : netty_transport_native_epoll_x86_64 cannot be loaded from java.libary.path, now trying export to -Dio.netty.native.workdir: /tmp java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) at java.lang.Runtime.loadLibrary0(Runtime.java:870) at java.lang.System.loadLibrary(System.java:1122) at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38) at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:243) at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:124) at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287) at io.netty.channel.epoll.Native. (Native.java:69) at io.netty.channel.epoll.Epoll. (Epoll.java:33) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at com.datastax.driver.core.NettyUtil. (NettyUtil.java:57) at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95) at com.datastax.driver.core.Connection$Factory. (Connection.java:926) at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499) at com.datastax.driver.core.Cluster.init(Cluster.java:208) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355) at com.datastax.driver.core.Cluster.connect(Cluster.java:305) at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272) at org.janusgraph.diskstorage.cql.CQLStoreManager. (CQLStoreManager.java:165) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58) at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477) at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409) at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration. (GraphDatabaseConfiguration.java:1382) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113) at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:73) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:54) at org.onap.aai.dbmap.AAIGraph$Helper. (AAIGraph.java:80) at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94) at org.onap.aai.GraphAdminApp.main(GraphAdminApp.java:135) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:595) Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) at java.lang.Runtime.loadLibrary0(Runtime.java:870) at java.lang.System.loadLibrary(System.java:1122) at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:263) at java.security.AccessController.doPrivileged(Native Method) at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:255) at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:233) ... 41 common frames omitted 2021-07-06 22:59:35.304 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : Successfully loaded the library /tmp/libnetty_transport_native_epoll_x86_644637677689056382386.so 2021-07-06 22:59:35.310 DEBUG 1 --- [ main] io.netty.util.NetUtil : Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) 2021-07-06 22:59:35.311 DEBUG 1 --- [ main] io.netty.util.NetUtil : /proc/sys/net/core/somaxconn: 128 2021-07-06 22:59:35.312 INFO 1 --- [ main] com.datastax.driver.core.NettyUtil : Found Netty's native epoll transport in the classpath, using it 2021-07-06 22:59:35.399 DEBUG 1 --- [ main] i.n.channel.MultithreadEventLoopGroup : -Dio.netty.eventLoopThreads: 4 2021-07-06 22:59:35.445 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : org.jctools-core.MpscChunkedArrayQueue: available 2021-07-06 22:59:35.461 DEBUG 1 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.level: simple 2021-07-06 22:59:35.461 DEBUG 1 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.targetRecords: 4 2021-07-06 22:59:35.461 DEBUG 1 --- [ main] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@4cd13fad 2021-07-06 22:59:35.472 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.EXTENDED_PEER_CHECK is undefined, using default value true 2021-07-06 22:59:35.537 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.60.71:9042] preparing to open 1 new connections, total = 1 2021-07-06 22:59:35.542 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.DISABLE_COALESCING is undefined, using default value false 2021-07-06 22:59:35.542 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_SCHEDULE_PERIOD_NS is undefined, using default value 10000 2021-07-06 22:59:35.542 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_RUN_WITHOUT_WORK_TIMES is undefined, using default value 5 2021-07-06 22:59:35.554 DEBUG 1 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 2021-07-06 22:59:35.554 DEBUG 1 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 2021-07-06 22:59:35.594 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numHeapArenas: 4 2021-07-06 22:59:35.594 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numDirectArenas: 4 2021-07-06 22:59:35.594 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.pageSize: 8192 2021-07-06 22:59:35.595 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxOrder: 11 2021-07-06 22:59:35.595 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.chunkSize: 16777216 2021-07-06 22:59:35.595 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.tinyCacheSize: 512 2021-07-06 22:59:35.595 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.smallCacheSize: 256 2021-07-06 22:59:35.595 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.normalCacheSize: 64 2021-07-06 22:59:35.595 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxCachedBufferCapacity: 32768 2021-07-06 22:59:35.595 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.cacheTrimInterval: 8192 2021-07-06 22:59:35.596 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.useCacheForAllThreads: true 2021-07-06 22:59:35.696 DEBUG 1 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.allocator.type: unpooled 2021-07-06 22:59:35.696 DEBUG 1 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.threadLocalDirectBufferSize: 65536 2021-07-06 22:59:35.696 DEBUG 1 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.maxThreadLocalCharBufferSize: 16384 2021-07-06 22:59:35.779 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 22:59:35.829 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxCapacity.default: 32768 2021-07-06 22:59:35.830 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxSharedCapacityFactor: 2 2021-07-06 22:59:35.831 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.linkCapacity: 16 2021-07-06 22:59:35.831 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.ratio: 8 2021-07-06 22:59:35.844 DEBUG 1 --- [er-nio-worker-0] io.netty.buffer.AbstractByteBuf : -Dio.netty.buffer.bytebuf.checkAccessible: true 2021-07-06 22:59:35.845 DEBUG 1 --- [er-nio-worker-0] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@2d38551b 2021-07-06 22:59:35.867 DEBUG 1 --- [er-nio-worker-0] c.datastax.driver.core.SystemProperties : com.datastax.driver.NATIVE_TRANSPORT_MAX_FRAME_SIZE_IN_MB is undefined, using default value 256 2021-07-06 22:59:36.590 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.60.71:9042] Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-06 22:59:36.592 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map 2021-07-06 22:59:36.702 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema 2021-07-06 22:59:37.008 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-07-06 22:59:37.016 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 8 milliseconds 2021-07-06 22:59:37.028 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.242.60.71:9042 2021-07-06 22:59:37.028 INFO 1 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor) 2021-07-06 22:59:37.030 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.181.80:9042 added 2021-07-06 22:59:37.030 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.30.195:9042 added 2021-07-06 22:59:37.030 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.242.60.71:9042 added 2021-07-06 22:59:37.035 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.CHECK_IO_DEADLOCKS is undefined, using default value true 2021-07-06 22:59:37.040 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.181.80:9042] preparing to open 1 new connections, total = 1 2021-07-06 22:59:37.042 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 22:59:37.049 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 22:59:37.049 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.60.71:9042] preparing to open 1 new connections, total = 2 2021-07-06 22:59:37.050 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 22:59:37.050 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 22:59:37.854 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-06 22:59:37.857 DEBUG 1 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.30.195:9042 (1 connections needed, 1 successfully opened) 2021-07-06 22:59:37.857 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Session : Added connection pool for /10.242.30.195:9042 2021-07-06 22:59:37.889 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.60.71:9042] Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-06 22:59:37.890 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.242.60.71:9042 (1 connections needed, 1 successfully opened) 2021-07-06 22:59:37.890 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for cassandra/10.242.60.71:9042 2021-07-06 22:59:37.986 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.181.80:9042] Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-06 22:59:37.987 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.181.80:9042 (1 connections needed, 1 successfully opened) 2021-07-06 22:59:37.987 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.242.181.80:9042 2021-07-06 22:59:38.703 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: file:/opt/app/aai-graphadmin/resources/ 2021-07-06 22:59:38.706 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/addmanualdata/README in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.706 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/addmanualdata/README in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.706 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.707 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.707 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.707 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.707 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.707 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.708 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/dynamic.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.708 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/dynamic.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.708 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/datatoolscrons.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.708 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/datatoolscrons.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.708 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.708 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.708 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-migration.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.708 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-migration.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.709 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.709 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.709 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.709 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.709 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.709 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.709 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.710 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.710 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.710 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.710 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.710 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.711 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.711 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.711 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.711 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.711 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.712 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.712 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.712 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.712 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.712 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.713 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.713 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.713 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.713 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.713 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.713 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.714 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.714 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.714 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.714 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.714 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.714 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.715 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.715 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.715 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.715 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.715 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.715 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.716 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.716 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.716 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.716 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.716 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.717 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.717 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.717 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.717 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.717 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.717 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.717 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.717 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.718 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.718 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.718 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.718 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.718 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.718 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.718 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.718 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.719 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.719 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.719 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.719 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.719 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.719 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.720 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.720 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.720 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.720 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.720 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.720 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.720 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.720 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.721 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.721 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.721 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.721 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.721 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.721 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.721 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.721 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.721 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.722 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.722 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.722 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.722 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.722 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.722 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.722 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.722 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.723 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.723 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.723 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.723 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.723 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.723 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.723 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.723 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.724 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.724 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.724 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.724 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.724 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.724 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.724 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.725 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.725 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.725 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.725 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.725 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.725 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.725 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.725 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.726 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.726 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.726 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.726 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.726 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.726 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.726 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.727 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.727 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.727 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.727 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.727 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.727 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.728 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.728 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.728 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.728 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.728 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.728 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.728 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.729 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.729 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.729 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.729 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.729 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.729 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.729 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.730 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.730 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.730 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.730 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.730 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.730 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.730 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.731 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.731 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.731 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.731 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.731 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.731 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.731 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.732 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.732 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.732 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.732 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.732 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.732 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.732 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.732 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.733 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.733 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.733 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.733 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.733 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.733 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.733 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.733 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.734 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.734 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.734 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.734 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.734 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.734 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.734 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dynamicPayloadGenerator-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.735 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dynamicPayloadGenerator-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.735 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file forceDelete-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.735 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file forceDelete-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.735 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file updatePropertyTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.735 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file updatePropertyTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.735 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.736 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.736 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.736 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.736 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.736 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.736 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file org/janusgraph/graphdb/configuration/janusgraph.internal.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.737 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file org/janusgraph/graphdb/configuration/janusgraph.internal.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.737 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schemaMod-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.737 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schemaMod-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.737 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.737 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.737 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dupeTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.737 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dupeTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.738 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file migration-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.738 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file migration-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.738 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file uniquePropertyCheck-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.738 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file uniquePropertyCheck-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.738 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-06 22:59:38.738 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-06 22:59:38.738 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 35 ms to scan 1 urls, producing 0 keys and 0 values 2021-07-06 22:59:39.198 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=true] closing connection 2021-07-06 22:59:39.198 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.181.80:9042] Connection[/10.242.181.80:9042-1, inFlight=0, closed=true] closed, remaining = 0 2021-07-06 22:59:39.202 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=true] closing connection 2021-07-06 22:59:39.202 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-1, inFlight=0, closed=true] closed, remaining = 0 2021-07-06 22:59:39.202 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=true] closing connection 2021-07-06 22:59:39.202 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.60.71:9042] Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=true] closed, remaining = 1 2021-07-06 22:59:39.211 DEBUG 1 --- [ main] com.datastax.driver.core.Cluster : Shutting down 2021-07-06 22:59:39.212 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=true] closing connection 2021-07-06 22:59:39.212 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.60.71:9042] Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=true] closed, remaining = 0 2021-07-06 22:59:41.432 DEBUG 1 --- [er-nio-worker-2] io.netty.buffer.PoolThreadCache : Freed 23 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-2 2021-07-06 22:59:41.432 DEBUG 1 --- [er-nio-worker-0] io.netty.buffer.PoolThreadCache : Freed 39 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-0 2021-07-06 22:59:41.454 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true 2021-07-06 22:59:41.455 INFO 1 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps. 2021-07-06 22:59:41.455 DEBUG 1 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.242.60.71:9042] 2021-07-06 22:59:41.460 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.60.71:9042] preparing to open 1 new connections, total = 1 2021-07-06 22:59:41.462 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 22:59:42.298 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.60.71:9042] Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-06 22:59:42.299 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map 2021-07-06 22:59:42.391 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema 2021-07-06 22:59:42.523 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-07-06 22:59:42.529 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 5 milliseconds 2021-07-06 22:59:42.540 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.242.60.71:9042 2021-07-06 22:59:42.540 INFO 1 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor) 2021-07-06 22:59:42.540 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.181.80:9042 added 2021-07-06 22:59:42.540 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.30.195:9042 added 2021-07-06 22:59:42.540 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.242.60.71:9042 added 2021-07-06 22:59:42.540 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.181.80:9042] preparing to open 1 new connections, total = 1 2021-07-06 22:59:42.541 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 22:59:42.541 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.60.71:9042] preparing to open 1 new connections, total = 2 2021-07-06 22:59:42.542 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 22:59:42.542 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 22:59:42.543 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 22:59:43.184 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.181.80:9042] Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-06 22:59:43.184 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.181.80:9042 (1 connections needed, 1 successfully opened) 2021-07-06 22:59:43.185 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.242.181.80:9042 2021-07-06 22:59:43.301 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.60.71:9042] Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-06 22:59:43.301 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.242.60.71:9042 (1 connections needed, 1 successfully opened) 2021-07-06 22:59:43.301 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for cassandra/10.242.60.71:9042 2021-07-06 22:59:43.450 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-06 22:59:43.450 DEBUG 1 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.30.195:9042 (1 connections needed, 1 successfully opened) 2021-07-06 22:59:43.450 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Session : Added connection pool for /10.242.30.195:9042 2021-07-06 22:59:47.248 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : GraphAdmin MicroService Started 2021-07-06 22:59:47.248 DEBUG 1 --- [ main] org.onap.aai.GraphAdminApp : GraphAdmin MicroService Started GraphAdmin Microservice Started 2021-07-06 23:00:12.498 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:00:12.501 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:00:16.887 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:00:16.889 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:00:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:00:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:00:42.502 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:00:42.506 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:00:52.745 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:00:52.747 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:01:07.884 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:01:07.890 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:01:12.506 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:01:12.586 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:01:28.151 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:01:28.154 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:01:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:01:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:01:42.587 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:01:42.589 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:02:08.492 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:02:08.495 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:02:12.590 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:02:12.592 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:02:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:02:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:02:42.593 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:02:42.594 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:02:49.146 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:02:49.149 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:03:12.595 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:03:12.597 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:03:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:03:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:03:39.597 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:03:39.599 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:03:42.597 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:03:42.599 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:03:54.946 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:03:54.949 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:04:12.600 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:04:12.690 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:04:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:04:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:04:42.690 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:04:42.692 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:05:12.692 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:05:12.694 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:05:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:05:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:05:42.694 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:05:42.696 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:06:05.889 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:06:05.892 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:06:10.893 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:06:10.895 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:06:12.697 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:06:12.785 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:06:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:06:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:06:40.896 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:06:40.898 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:06:42.785 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:06:42.788 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:06:55.946 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:06:55.951 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:07:12.788 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:07:12.790 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:07:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:07:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:07:36.392 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:07:36.394 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:07:42.791 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:07:42.793 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:08:06.882 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:08:11.889 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:08:11.890 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:08:12.793 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:08:12.795 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:08:18.965 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-1, inFlight=1, closed=false] because: [/10.242.30.195:9042] Heartbeat query timed out 2021-07-06 23:08:18.974 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preventing new connections for the next 1000 ms 2021-07-06 23:08:18.974 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-1, inFlight=1, closed=false] failed, remaining = 0 2021-07-06 23:08:18.988 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=1, closed=true] closing connection 2021-07-06 23:08:18.989 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.30.195:9042-1, inFlight=1, closed=true]: there are still pending requests 2021-07-06 23:08:18.988 DEBUG 1 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] marking host DOWN 2021-07-06 23:08:18.992 DEBUG 1 --- [luster-worker-2] com.datastax.driver.core.RequestHandler : onException triggered but the response was completed by another thread, cancelling (retryCount = 0, queryState = QueryState(count=0, inProgress=false, cancelled=false), queryStateRef = QueryState(count=0, inProgress=false, cancelled=false)) 2021-07-06 23:08:18.995 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2085966857-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f6f5342 at consistency LOCAL_QUORUM 2021-07-06 23:08:18.996 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2085966857-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.TransportException: [/10.242.30.195:9042] Connection has been closed 2021-07-06 23:08:19.000 DEBUG 1 --- [luster-worker-2] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-07-06 23:08:19.001 DEBUG 1 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] starting reconnection attempt 2021-07-06 23:08:20.001 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 23:08:20.003 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 23:08:25.198 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-06 23:08:25.199 DEBUG 1 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.30.195:9042 2021-07-06 23:08:25.203 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Successful reconnection to /10.242.30.195:9042, setting host UP 2021-07-06 23:08:25.204 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] marking host UP 2021-07-06 23:08:25.204 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP 2021-07-06 23:08:25.204 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.30.195:9042 2021-07-06 23:08:25.590 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 0 new connections, total = 1 2021-07-06 23:08:25.590 DEBUG 1 --- [-reconnection-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.30.195:9042 (1 connections needed, 1 successfully opened) 2021-07-06 23:08:25.592 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Session : Added connection pool for /10.242.30.195:9042 2021-07-06 23:08:25.594 DEBUG 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future 2021-07-06 23:08:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:08:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:08:55.203 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:08:55.285 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:08:56.464 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-1, inFlight=0, closed=true] has already terminated 2021-07-06 23:09:09.354 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:09:09.373 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:09:25.285 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:09:25.290 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:09:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:09:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:09:55.291 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:09:55.293 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:10:25.293 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:10:25.296 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:10:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:10:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:10:46.486 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:10:46.488 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:10:55.296 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:10:55.298 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:11:21.895 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:11:21.898 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:11:25.299 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:11:25.385 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:11:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:11:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:11:55.386 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:11:55.394 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:12:25.394 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:12:25.397 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:12:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:12:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:12:38.087 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:12:38.961 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] heartbeat query succeeded 2021-07-06 23:12:55.397 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:12:55.399 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:13:09.263 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:13:09.293 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:13:25.399 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:13:25.401 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:13:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:13:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:13:54.849 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:13:54.861 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:13:55.401 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:13:55.403 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:14:25.403 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:14:25.405 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:14:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:14:32.658 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:14:45.150 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:14:45.389 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:14:55.405 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:14:55.407 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:15:05.285 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:15:05.289 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:15:25.408 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:15:25.409 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:15:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:15:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:15:35.289 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:15:35.292 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:15:55.410 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:15:55.419 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:15:56.589 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:15:56.596 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:16:25.419 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:16:25.484 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:16:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:16:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:16:47.104 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:16:47.106 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:16:55.485 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:16:55.486 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:17:25.487 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:17:25.490 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:17:27.683 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:17:27.685 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:17:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:17:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:17:48.186 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:17:48.190 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:17:55.490 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:17:55.493 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:18:25.493 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:18:25.497 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:18:32.662 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:18:32.664 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:18:44.213 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:18:44.321 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:18:55.498 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:18:55.499 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:19:04.484 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:19:04.486 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:19:25.500 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:19:25.503 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:19:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:19:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:19:40.688 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:19:40.690 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:19:50.889 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:19:50.890 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:19:55.503 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:19:55.504 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:20:20.891 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:20:20.892 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:20:25.505 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:20:25.507 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:20:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:20:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:20:55.507 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:20:55.584 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:21:07.484 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:21:07.486 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:21:10.164 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [85657981-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@626f68d5 at consistency LOCAL_QUORUM 2021-07-06 23:21:10.165 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [85657981-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:21:14.712 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.30.195:9042, scheduling delivery 2021-07-06 23:21:14.716 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event DOWN 2021-07-06 23:21:15.721 DEBUG 1 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.30.195:9042 because it still has active connections 2021-07-06 23:21:17.885 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:21:17.886 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:21:23.066 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:21:24.654 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] heartbeat query succeeded 2021-07-06 23:21:27.263 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1466091328-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@e1a6c70 at consistency LOCAL_QUORUM 2021-07-06 23:21:27.263 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1466091328-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:21:29.249 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 7104 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ROWS [4 columns] --- 2021-07-06 23:21:29.249 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 7168 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ROWS [4 columns] --- 2021-07-06 23:21:29.788 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.30.195:9042, scheduling delivery 2021-07-06 23:21:29.788 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event UP 2021-07-06 23:21:30.791 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.30.195:9042 2021-07-06 23:21:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:21:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:21:47.887 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:21:47.888 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:22:00.794 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:22:00.795 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:22:30.796 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:22:30.798 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:22:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:22:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:22:50.189 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:22:50.741 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:23:00.798 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:23:00.800 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:23:30.800 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:23:30.802 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:23:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:23:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:24:00.802 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:24:00.806 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:24:05.893 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:24:05.895 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:24:30.806 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:24:30.809 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:24:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:24:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:24:41.888 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:24:41.890 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:24:49.263 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [492629467-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1af00952 at consistency LOCAL_QUORUM 2021-07-06 23:24:49.264 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [492629467-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:24:52.265 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 8000 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ROWS [4 columns] --- 2021-07-06 23:25:00.809 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:25:00.812 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:25:10.785 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.30.195:9042, scheduling delivery 2021-07-06 23:25:10.785 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event DOWN 2021-07-06 23:25:11.786 DEBUG 1 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.30.195:9042 because it still has active connections 2021-07-06 23:25:16.989 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.30.195:9042, scheduling delivery 2021-07-06 23:25:16.989 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event UP 2021-07-06 23:25:17.789 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.30.195:9042, scheduling delivery 2021-07-06 23:25:17.789 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event DOWN 2021-07-06 23:25:18.790 DEBUG 1 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.30.195:9042 because it still has active connections 2021-07-06 23:25:19.687 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.30.195:9042, scheduling delivery 2021-07-06 23:25:19.687 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event UP 2021-07-06 23:25:20.689 DEBUG 1 --- [luster-worker-4] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.30.195:9042 2021-07-06 23:25:22.266 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:25:25.351 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:25:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:25:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:25:50.692 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:25:50.694 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:26:19.887 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:26:19.889 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:26:20.694 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:26:20.695 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:26:24.891 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:26:24.893 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:26:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:26:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:26:49.078 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:26:49.143 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:26:50.696 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:26:50.697 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:27:14.387 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:27:14.388 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:27:20.697 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:27:20.788 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:27:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:27:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:27:50.788 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:27:50.791 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:28:09.994 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:28:09.996 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:28:15.084 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:28:15.086 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:28:20.791 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:28:20.792 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:28:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:28:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:28:50.494 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:28:50.496 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:28:50.793 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:28:50.794 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:29:00.588 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:29:00.590 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:29:20.795 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:29:20.798 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:29:31.085 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:29:31.087 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:29:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:29:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:29:50.798 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:29:50.802 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:30:20.803 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:30:20.884 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:30:21.401 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:30:21.402 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:30:24.064 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [438862441-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5f40ac0d at consistency LOCAL_QUORUM 2021-07-06 23:30:24.064 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [438862441-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:30:30.286 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.30.195:9042, scheduling delivery 2021-07-06 23:30:30.287 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event DOWN 2021-07-06 23:30:31.287 DEBUG 1 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.30.195:9042 because it still has active connections 2021-07-06 23:30:31.791 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 9536 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 0 responses. 2021-07-06 23:30:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:30:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:30:51.262 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [270122644-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@46705ef0 at consistency LOCAL_QUORUM 2021-07-06 23:30:51.263 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [270122644-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:30:53.582 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 9600 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses. 2021-07-06 23:31:00.287 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:31:00.289 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:31:18.363 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1873527375-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1b54d3a2 at consistency LOCAL_QUORUM 2021-07-06 23:31:18.364 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1873527375-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:31:23.582 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:31:26.291 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:31:26.294 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:31:30.161 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] heartbeat query succeeded 2021-07-06 23:31:30.163 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 9664 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ROWS [4 columns] --- 2021-07-06 23:31:30.289 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:31:30.291 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:31:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:31:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:31:48.385 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:31:48.388 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:32:00.164 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:32:00.291 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:32:00.292 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:32:02.263 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1827704014-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1f4e303 at consistency LOCAL_QUORUM 2021-07-06 23:32:02.263 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1827704014-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:32:07.080 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 9856 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses. 2021-07-06 23:32:07.898 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:32:17.053 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.30.195:9042, scheduling delivery 2021-07-06 23:32:17.054 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event UP 2021-07-06 23:32:18.056 DEBUG 1 --- [luster-worker-5] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.30.195:9042 2021-07-06 23:32:32.286 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:32:32.288 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:32:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:32:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:32:48.086 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:32:48.089 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:33:07.192 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:33:07.194 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:33:18.089 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:33:18.091 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:33:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:33:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:33:39.684 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:33:39.686 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:33:48.091 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:33:48.093 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:34:06.941 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:34:07.278 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:34:18.093 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:34:18.098 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:34:21.997 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:34:21.998 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:34:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:34:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:34:42.095 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:34:42.096 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:34:48.099 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:34:48.101 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:35:18.102 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:35:18.190 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:35:27.545 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:35:30.185 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] heartbeat query succeeded 2021-07-06 23:35:32.585 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:35:32.587 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:35:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:35:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:35:48.190 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:35:48.192 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:35:52.600 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:35:52.684 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:36:08.300 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.30.195:9042, scheduling delivery 2021-07-06 23:36:08.301 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event DOWN 2021-07-06 23:36:09.302 DEBUG 1 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.30.195:9042 because it still has active connections 2021-07-06 23:36:10.629 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:36:18.845 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] heartbeat query succeeded 2021-07-06 23:36:27.863 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [396377661-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5b0e17f4 at consistency LOCAL_QUORUM 2021-07-06 23:36:27.864 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [396377661-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:36:30.094 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 10944 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses. 2021-07-06 23:36:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:36:32.658 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:36:38.302 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:36:38.387 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:36:49.963 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1414890407-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1fcd45bb at consistency LOCAL_QUORUM 2021-07-06 23:36:49.965 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1414890407-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:36:51.553 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 11008 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 0 responses. 2021-07-06 23:37:02.901 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:37:02.903 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:37:03.482 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-06T23:36:37.401Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 23 common frames omitted 2021-07-06 23:37:08.387 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:37:08.388 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:37:19.985 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:37:19.987 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:37:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:37:32.658 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:37:33.447 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:37:36.549 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:37:38.389 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:37:38.390 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:37:49.987 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:37:49.990 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:37:50.664 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [509942417-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@22394c23 at consistency LOCAL_QUORUM 2021-07-06 23:37:50.664 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [509942417-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:37:54.546 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 11200 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses. 2021-07-06 23:38:03.587 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:38:03.589 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:38:08.391 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:38:08.392 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:38:12.763 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [590560761-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f35f9c at consistency LOCAL_QUORUM 2021-07-06 23:38:12.763 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [590560761-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:38:24.547 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:38:24.594 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] heartbeat query succeeded 2021-07-06 23:38:29.862 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [35530727-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2f695941 at consistency LOCAL_QUORUM 2021-07-06 23:38:29.863 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [35530727-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:38:31.576 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 11264 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR UNAVAILABLE: Cannot achieve consistency level LOCAL_QUORUM 2021-07-06 23:38:31.653 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] Response received on stream 11328 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR UNAVAILABLE: Cannot achieve consistency level LOCAL_QUORUM 2021-07-06 23:38:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:38:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:38:33.590 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:38:33.591 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:38:38.393 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:38:38.394 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:38:48.290 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [489988904-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3253a75f at consistency null 2021-07-06 23:38:48.290 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [489988904-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-06 23:39:04.889 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:39:04.891 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:39:05.462 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1860603510-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5afc218a at consistency LOCAL_QUORUM 2021-07-06 23:39:05.463 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1860603510-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-06 23:39:08.394 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:39:08.395 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:39:18.290 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:39:30.363 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] because: [/10.242.30.195:9042] Heartbeat query timed out 2021-07-06 23:39:30.364 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preventing new connections for the next 1000 ms 2021-07-06 23:39:30.364 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-2, inFlight=1, closed=false] failed, remaining = 0 2021-07-06 23:39:30.365 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=1, closed=true] closing connection 2021-07-06 23:39:30.365 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.30.195:9042-2, inFlight=1, closed=true]: there are still pending requests 2021-07-06 23:39:30.365 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] marking host DOWN 2021-07-06 23:39:30.366 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [421790136-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@491b7743 at consistency LOCAL_QUORUM 2021-07-06 23:39:30.366 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [421790136-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.TransportException: [/10.242.30.195:9042] Connection has been closed 2021-07-06 23:39:30.366 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.RequestHandler : onException triggered but the response was completed by another thread, cancelling (retryCount = 0, queryState = QueryState(count=0, inProgress=false, cancelled=false), queryStateRef = QueryState(count=0, inProgress=false, cancelled=false)) 2021-07-06 23:39:30.368 DEBUG 1 --- [luster-worker-6] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-07-06 23:39:30.369 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] starting reconnection attempt 2021-07-06 23:39:31.369 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 23:39:31.371 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-3, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 23:39:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:39:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:39:35.517 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-3, inFlight=0, closed=false] because: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:39:35.517 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-3, inFlight=0, closed=false] failed, remaining = 0 2021-07-06 23:39:35.517 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-3, inFlight=0, closed=true] closing connection 2021-07-06 23:39:35.518 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-06 23:39:35.518 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-3, inFlight=0, closed=true] has already terminated 2021-07-06 23:39:35.519 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:39:35.520 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.30.195:9042, scheduling retry in 2000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-06 23:39:35.521 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 2000 ms 2021-07-06 23:39:37.521 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 23:39:37.523 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-4, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 23:39:38.396 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:39:38.397 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:39:44.263 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-4, inFlight=0, closed=false] because: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:39:44.265 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-4, inFlight=0, closed=false] failed, remaining = 0 2021-07-06 23:39:44.265 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-4, inFlight=0, closed=true] closing connection 2021-07-06 23:39:44.265 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-06 23:39:44.265 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-4, inFlight=0, closed=true] has already terminated 2021-07-06 23:39:44.265 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:39:44.266 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.30.195:9042, scheduling retry in 4000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-06 23:39:44.267 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 4000 ms 2021-07-06 23:39:48.267 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 23:39:48.269 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-5, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 23:39:50.646 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-5, inFlight=0, closed=false] because: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:39:50.646 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-5, inFlight=0, closed=false] failed, remaining = 0 2021-07-06 23:39:50.646 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-5, inFlight=0, closed=true] closing connection 2021-07-06 23:39:50.646 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-06 23:39:50.647 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-5, inFlight=0, closed=true] has already terminated 2021-07-06 23:39:50.647 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:39:50.647 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.30.195:9042, scheduling retry in 8000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-06 23:39:50.648 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 8000 ms 2021-07-06 23:39:56.489 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-2, inFlight=0, closed=true] has already terminated 2021-07-06 23:39:58.648 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 23:39:58.651 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-6, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 23:39:58.655 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-6, inFlight=0, closed=false] because: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:39:58.655 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-6, inFlight=0, closed=false] failed, remaining = 0 2021-07-06 23:39:58.656 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-6, inFlight=0, closed=true] closing connection 2021-07-06 23:39:58.656 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-06 23:39:58.656 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-6, inFlight=0, closed=true] has already terminated 2021-07-06 23:39:58.656 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:39:58.657 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.30.195:9042, scheduling retry in 16000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-06 23:39:58.658 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 16000 ms 2021-07-06 23:40:08.397 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:40:08.399 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:40:14.659 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 23:40:14.660 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-7, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 23:40:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:40:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:40:34.564 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-7, inFlight=0, closed=false] because: [/10.242.30.195:9042] Operation timed out 2021-07-06 23:40:34.564 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-7, inFlight=0, closed=false] failed, remaining = 0 2021-07-06 23:40:34.565 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-7, inFlight=0, closed=true] closing connection 2021-07-06 23:40:34.565 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.30.195:9042-7, inFlight=0, closed=true]: there are still pending requests 2021-07-06 23:40:34.565 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-06 23:40:34.567 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.30.195:9042 ([/10.242.30.195:9042] Operation timed out), scheduling retry in 32000 milliseconds 2021-07-06 23:40:34.567 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 32000 ms 2021-07-06 23:40:38.399 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:40:38.401 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:41:06.567 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 23:41:06.570 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-8, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 23:41:08.401 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:41:08.403 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:41:11.490 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-7, inFlight=0, closed=true] has already terminated 2021-07-06 23:41:21.263 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-8, inFlight=0, closed=false] because: [/10.242.30.195:9042] Operation timed out 2021-07-06 23:41:21.263 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-8, inFlight=0, closed=false] failed, remaining = 0 2021-07-06 23:41:21.264 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-8, inFlight=0, closed=true] closing connection 2021-07-06 23:41:21.264 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.30.195:9042-8, inFlight=0, closed=true]: there are still pending requests 2021-07-06 23:41:21.264 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-06 23:41:21.265 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.30.195:9042 ([/10.242.30.195:9042] Operation timed out), scheduling retry in 64000 milliseconds 2021-07-06 23:41:21.265 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 64000 ms 2021-07-06 23:41:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:41:32.658 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:41:38.403 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:41:38.405 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:41:56.491 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-8, inFlight=0, closed=true] has already terminated 2021-07-06 23:42:08.405 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:42:08.484 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:42:25.266 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 23:42:25.270 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-9, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 23:42:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:42:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:42:33.802 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-9, inFlight=0, closed=false] because: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:42:33.802 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-9, inFlight=0, closed=false] failed, remaining = 0 2021-07-06 23:42:33.803 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-9, inFlight=0, closed=true] closing connection 2021-07-06 23:42:33.803 DEBUG 1 --- [uster-worker-10] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-06 23:42:33.803 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-9, inFlight=0, closed=true] has already terminated 2021-07-06 23:42:33.804 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:42:33.805 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.30.195:9042, scheduling retry in 128000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-06 23:42:33.807 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 128000 ms 2021-07-06 23:42:38.485 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:42:38.487 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:43:08.487 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:43:08.489 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:43:31.293 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:43:31.295 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:43:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:43:32.658 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:43:38.489 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:43:38.491 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:43:56.392 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:43:56.394 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:44:08.492 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:44:08.493 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:44:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:44:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:44:38.493 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:44:38.496 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:44:41.808 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 23:44:41.811 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-10, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 23:44:46.842 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-10, inFlight=0, closed=false] because: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:44:46.843 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-10, inFlight=0, closed=false] failed, remaining = 0 2021-07-06 23:44:46.844 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-10, inFlight=0, closed=true] closing connection 2021-07-06 23:44:46.844 DEBUG 1 --- [uster-worker-11] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-06 23:44:46.844 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-10, inFlight=0, closed=true] has already terminated 2021-07-06 23:44:46.844 ERROR 1 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:44:46.845 ERROR 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.30.195:9042, scheduling retry in 256000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-06 23:44:46.846 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 256000 ms 2021-07-06 23:45:00.001 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:00.148 DEBUG 1 --- [ scheduling-1] o.o.aai.datasnapshot.DataSnapshotTasks : Exit value of the dataSnapshot check process: 1 2021-07-06 23:45:00.149 DEBUG 1 --- [ scheduling-1] o.o.aai.datasnapshot.DataSnapshotTasks : Started cron job dataSnapshot @ 23:45:00 2021-07-06 23:45:00.149 DEBUG 1 --- [ scheduling-1] o.o.aai.datasnapshot.DataSnapshotTasks : DataSnapshot Params [-c, JUST_TAKE_SNAPSHOT] 2021-07-06 23:45:00.200 WARN 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : WARNING - could not get [aai.datasnapshot.threads.for.create] value from aaiconfig.properties file. Property key aai.datasnapshot.threads.for.create cannot be found 2021-07-06 23:45:00.201 WARN 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : WARNING - could not get [aai.datasnapshot.max.nodes.per.file.for.create] value from aaiconfig.properties file. Property key aai.datasnapshot.max.nodes.per.file.for.create cannot be found 2021-07-06 23:45:00.201 WARN 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : WARNING - could not get [aai.datasnapshot.vertex.add.delay.ms] value from aaiconfig.properties file. Property key aai.datasnapshot.vertex.add.delay.ms cannot be found 2021-07-06 23:45:00.201 WARN 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : WARNING - could not get [aai.datasnapshot.edge.add.delay.ms] value from aaiconfig.properties file. Property key aai.datasnapshot.edge.add.delay.ms cannot be found 2021-07-06 23:45:00.201 WARN 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : WARNING - could not get [aai.datasnapshot.failure.delay.ms] value from aaiconfig.properties file. Property key aai.datasnapshot.failure.delay.ms cannot be found 2021-07-06 23:45:00.201 WARN 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : WARNING - could not get [aai.datasnapshot.retry.delay.ms] value from aaiconfig.properties file. Property key aai.datasnapshot.retry.delay.ms cannot be found 2021-07-06 23:45:00.201 WARN 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : WARNING - could not get [aai.datasnapshot.max.errors.per.thread] value from aaiconfig.properties file. Property key aai.datasnapshot.max.errors.per.thread cannot be found 2021-07-06 23:45:00.201 WARN 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : WARNING - could not get [aai.datasnapshot.vertex.to.edge.proc.delay.ms] value from aaiconfig.properties file. Property key aai.datasnapshot.vertex.to.edge.proc.delay.ms cannot be found 2021-07-06 23:45:00.201 WARN 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : WARNING - could not get [aai.datasnapshot.stagger.thread.delay.ms] value from aaiconfig.properties file. Property key aai.datasnapshot.stagger.thread.delay.ms cannot be found 2021-07-06 23:45:00.255 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DataSnapshot command is [JUST_TAKE_SNAPSHOT] 2021-07-06 23:45:00.255 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : File name to reload snapshot [] 2021-07-06 23:45:00.255 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : snapshotType is [graphson] 2021-07-06 23:45:00.255 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Thread count is [15] 2021-07-06 23:45:00.255 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Max Nodes Per File is [120000] 2021-07-06 23:45:00.256 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Debug Flag is [] 2021-07-06 23:45:00.256 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DebugAddDelayTimer is [1] 2021-07-06 23:45:00.256 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : VertAddDelayMs is [1] 2021-07-06 23:45:00.256 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : FailureDelayMs is [50] 2021-07-06 23:45:00.256 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : RetryDelayMs is [50] 2021-07-06 23:45:00.256 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : MaxErrorsPerThread is [25] 2021-07-06 23:45:00.256 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : VertToEdgeProcDelay is [9000] 2021-07-06 23:45:00.256 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : StaggerThreadDelay is [5000] 2021-07-06 23:45:00.256 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Caller process is [] 2021-07-06 23:45:00.256 INFO 1 --- [ scheduling-1] org.onap.aai.util.AAIConfig : Initializing AAIConfig 2021-07-06 23:45:00.257 DEBUG 1 --- [ scheduling-1] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-graphadmin/./resources/etc/appprops/aaiconfig.properties 2021-07-06 23:45:00.257 INFO 1 --- [ scheduling-1] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-graphadmin/./resources/etc/appprops/aaiconfig.properties 2021-07-06 23:45:00.257 INFO 1 --- [ scheduling-1] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename 2021-07-06 23:45:00.261 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Command = JUST_TAKE_SNAPSHOT, oldSnapshotFileName = []. 2021-07-06 23:45:00.261 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : ---- NOTE --- about to open graph (takes a little while) 2021-07-06 23:45:00.261 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Command = JUST_TAKE_SNAPSHOT 2021-07-06 23:45:00.264 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Successfully got the Graph instance. 2021-07-06 23:45:00.266 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is query.fast-propertyValue is true 2021-07-06 23:45:00.266 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is query.smart-limitValue is false 2021-07-06 23:45:00.267 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is storage.backendValue is cql 2021-07-06 23:45:00.267 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is storage.hostnameValue is cassandra 2021-07-06 23:45:00.267 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is storage.cql.keyspaceValue is aaigraph 2021-07-06 23:45:00.267 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is storage.usernameValue is cassandra 2021-07-06 23:45:00.267 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is storage.passwordValue is cassandra 2021-07-06 23:45:00.267 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is storage.cql.read-consistency-levelValue is LOCAL_QUORUM 2021-07-06 23:45:00.267 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is storage.cql.write-consistency-levelValue is LOCAL_QUORUM 2021-07-06 23:45:00.268 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is storage.cql.replication-factorValue is 3 2021-07-06 23:45:00.268 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is storage.cql.only-use-local-consistency-for-system-operationsValue is true 2021-07-06 23:45:00.268 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is storage.lock.wait-timeValue is 300 2021-07-06 23:45:00.268 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is cache.db-cacheValue is false 2021-07-06 23:45:00.268 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is load.snapshot.fileValue is false 2021-07-06 23:45:00.268 INFO 1 --- [ scheduling-1] org.onap.aai.util.GraphAdminDBUtils : Key is graph.unique-instance-idValue is 1_aai-graphadmin_GraphAdminApp_realtime_1625612374836 2021-07-06 23:45:00.268 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Count how many nodes are in the db. 2021-07-06 23:45:00.454 WARN 1 --- [ scheduling-1] o.j.g.transaction.StandardJanusGraphTx : Query requires iterating over all vertices [()]. For better performance, use indexes 2021-07-06 23:45:02.792 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : -- To count all vertices in DB it took: 0 minutes, 2 seconds 2021-07-06 23:45:02.792 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Total Count of Nodes in DB = 426. 2021-07-06 23:45:02.794 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : We will run this many simultaneous threads: 15 2021-07-06 23:45:02.794 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Required number of passes: 1 2021-07-06 23:45:02.794 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Max Nodes per file: 120000 2021-07-06 23:45:02.794 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : We will generate this many files: 15 2021-07-06 23:45:02.794 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Each file will have (roughly): 29 nodes. 2021-07-06 23:45:02.794 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Now, divide vertexIds across this many files: 15 2021-07-06 23:45:04.005 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : -- To Loop over all vertices, and put them into sub-Arrays it took: 0 minutes, 1 seconds 2021-07-06 23:45:04.006 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 0 2021-07-06 23:45:04.009 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 1 2021-07-06 23:45:04.009 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 2 2021-07-06 23:45:04.009 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 3 2021-07-06 23:45:04.010 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 4 2021-07-06 23:45:04.010 INFO 1 --- [ Thread-32] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.010 INFO 1 --- [ Thread-34] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.010 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 5 2021-07-06 23:45:04.010 INFO 1 --- [ Thread-33] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.010 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 6 2021-07-06 23:45:04.010 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 7 2021-07-06 23:45:04.010 INFO 1 --- [ Thread-35] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.011 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 8 2021-07-06 23:45:04.011 INFO 1 --- [ Thread-37] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.011 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 9 2021-07-06 23:45:04.011 INFO 1 --- [ Thread-36] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.011 INFO 1 --- [ Thread-39] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.011 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 10 2021-07-06 23:45:04.011 INFO 1 --- [ Thread-38] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.011 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 11 2021-07-06 23:45:04.011 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 12 2021-07-06 23:45:04.011 INFO 1 --- [ Thread-41] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.012 INFO 1 --- [ Thread-40] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.013 INFO 1 --- [ Thread-42] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.013 INFO 1 --- [ Thread-43] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.015 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 13 2021-07-06 23:45:04.016 INFO 1 --- [ Thread-44] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.017 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : DEBUG >>> kick off pass # 1, thread # 14 2021-07-06 23:45:04.017 INFO 1 --- [ Thread-45] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:04.019 INFO 1 --- [ Thread-46] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:08.496 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:45:08.497 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded -- Printed 21 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P14 2021-07-06 23:45:09.489 DEBUG 1 --- [ Thread-46] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 21 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P14 2021-07-06 23:45:09.490 INFO 1 --- [ Thread-46] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P2 2021-07-06 23:45:10.285 DEBUG 1 --- [ Thread-34] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P2 2021-07-06 23:45:10.285 INFO 1 --- [ Thread-34] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P11 -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P1 2021-07-06 23:45:10.292 DEBUG 1 --- [ Thread-33] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P1 2021-07-06 23:45:10.292 DEBUG 1 --- [ Thread-43] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P11 2021-07-06 23:45:10.292 INFO 1 --- [ Thread-33] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:45:10.293 INFO 1 --- [ Thread-43] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P10 2021-07-06 23:45:10.293 DEBUG 1 --- [ Thread-42] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P10 2021-07-06 23:45:10.294 INFO 1 --- [ Thread-42] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P3 2021-07-06 23:45:10.385 DEBUG 1 --- [ Thread-35] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P3 2021-07-06 23:45:10.385 INFO 1 --- [ Thread-35] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P12 2021-07-06 23:45:10.387 DEBUG 1 --- [ Thread-44] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P12 2021-07-06 23:45:10.388 INFO 1 --- [ Thread-44] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P5 -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P6 2021-07-06 23:45:10.388 DEBUG 1 --- [ Thread-37] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P5 2021-07-06 23:45:10.388 DEBUG 1 --- [ Thread-38] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P6 2021-07-06 23:45:10.389 INFO 1 --- [ Thread-37] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:45:10.389 INFO 1 --- [ Thread-38] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P7 2021-07-06 23:45:10.493 DEBUG 1 --- [ Thread-39] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P7 2021-07-06 23:45:10.494 INFO 1 --- [ Thread-39] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P8 2021-07-06 23:45:10.585 DEBUG 1 --- [ Thread-40] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P8 2021-07-06 23:45:10.586 INFO 1 --- [ Thread-40] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P9 2021-07-06 23:45:10.589 DEBUG 1 --- [ Thread-41] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P9 -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P13 2021-07-06 23:45:10.590 DEBUG 1 --- [ Thread-45] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P13 2021-07-06 23:45:10.590 INFO 1 --- [ Thread-41] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:45:10.590 INFO 1 --- [ Thread-45] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P4 2021-07-06 23:45:10.685 DEBUG 1 --- [ Thread-36] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 29 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P4 2021-07-06 23:45:10.686 INFO 1 --- [ Thread-36] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. -- Printed 28 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P0 2021-07-06 23:45:10.890 DEBUG 1 --- [ Thread-32] o.o.aai.datasnapshot.PrintVertexDetails : PrintVertexDetails -- Printed 28 vertexes out to /opt/app/aai-graphadmin/logs/data/dataSnapshots/dataSnapshot.graphSON.202107062345.P0 2021-07-06 23:45:10.890 INFO 1 --- [ Thread-32] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:45:10.891 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : Pass number 1 (out of 1) took 0 minutes, 6 seconds 2021-07-06 23:45:10.891 DEBUG 1 --- [ scheduling-1] org.onap.aai.datasnapshot.DataSnapshot : -- To write all the data out to snapshot files, it took: 0 minutes, 6 seconds 2021-07-06 23:45:10.892 DEBUG 1 --- [ scheduling-1] o.o.aai.datasnapshot.DataSnapshotTasks : Ended cron job dataSnapshot @ 23:45:10 2021-07-06 23:45:10.893 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:45:32.652 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:45:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:45:38.498 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:45:38.499 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:46:08.499 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:46:08.502 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:46:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:46:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:46:38.508 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:46:38.584 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:46:42.193 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:46:42.195 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:47:08.585 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:47:08.586 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:47:27.395 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:47:27.396 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:47:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:47:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:47:38.586 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:47:38.588 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:48:07.595 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:48:07.597 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:48:08.589 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:48:08.590 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:48:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:48:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:48:38.590 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:48:38.592 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:48:42.888 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:48:42.890 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:49:02.847 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 23:49:02.849 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-11, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 23:49:08.592 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:49:08.594 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:49:14.863 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-11, inFlight=0, closed=false] because: [/10.242.30.195:9042] Operation timed out 2021-07-06 23:49:14.864 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-11, inFlight=0, closed=false] failed, remaining = 0 2021-07-06 23:49:14.865 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-11, inFlight=0, closed=true] closing connection 2021-07-06 23:49:14.865 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.30.195:9042-11, inFlight=0, closed=true]: there are still pending requests 2021-07-06 23:49:14.865 DEBUG 1 --- [uster-worker-12] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-06 23:49:14.865 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.30.195:9042 ([/10.242.30.195:9042] Operation timed out), scheduling retry in 512000 milliseconds 2021-07-06 23:49:14.865 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 512000 ms 2021-07-06 23:49:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:49:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:49:38.594 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:49:38.596 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:49:41.498 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-11, inFlight=0, closed=true] has already terminated 2021-07-06 23:50:08.292 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:50:08.294 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:50:08.596 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:50:08.598 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:50:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:50:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:50:38.599 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:50:38.601 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:51:08.601 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:51:08.603 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:51:28.594 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:51:28.597 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:51:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:51:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:51:38.603 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:51:38.605 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:52:08.605 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:52:08.684 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:52:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:52:32.658 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:52:38.684 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:52:38.686 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:53:08.686 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:53:08.689 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:53:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:53:32.663 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:53:38.689 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:53:38.691 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:54:08.691 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:54:08.693 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:54:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:54:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:54:38.693 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:54:38.695 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:55:08.695 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:55:08.698 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:55:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:55:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:55:34.798 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:55:34.800 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:55:38.698 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:55:38.700 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:56:08.700 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:56:08.702 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:56:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:56:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:56:35.097 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:56:35.099 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:56:38.702 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:56:38.784 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:57:08.785 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:57:08.789 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:57:20.291 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:57:20.293 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:57:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:57:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:57:38.789 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:57:38.808 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:57:46.866 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-06 23:57:46.871 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-12, inFlight=0, closed=false] Connection established, initializing transport 2021-07-06 23:57:58.793 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-12, inFlight=0, closed=false] because: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:57:58.793 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-12, inFlight=0, closed=false] failed, remaining = 0 2021-07-06 23:57:58.794 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-12, inFlight=0, closed=true] closing connection 2021-07-06 23:57:58.794 DEBUG 1 --- [uster-worker-13] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-06 23:57:58.795 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-12, inFlight=0, closed=true] has already terminated 2021-07-06 23:57:58.795 ERROR 1 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-06 23:57:58.798 ERROR 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.30.195:9042, scheduling retry in 600000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-06 23:57:58.800 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 600000 ms 2021-07-06 23:58:08.808 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:58:08.884 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:58:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:58:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:58:38.885 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:58:38.887 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:59:08.887 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:59:08.889 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-06 23:59:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-06 23:59:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-06 23:59:38.890 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-06 23:59:38.893 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:00:08.893 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:00:08.895 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:00:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:00:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:00:38.896 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:00:38.898 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:01:08.898 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:01:08.900 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:01:31.294 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:01:31.303 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:01:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:01:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:01:38.901 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:01:38.903 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:02:08.903 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:02:08.905 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:02:25.688 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.30.195:9042, scheduling delivery 2021-07-07 00:02:25.688 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event UP 2021-07-07 00:02:26.690 DEBUG 1 --- [uster-worker-14] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.30.195:9042 2021-07-07 00:02:26.705 DEBUG 1 --- [uster-worker-14] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] marking host UP 2021-07-07 00:02:26.705 DEBUG 1 --- [uster-worker-14] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP 2021-07-07 00:02:26.705 DEBUG 1 --- [uster-worker-14] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.30.195:9042 2021-07-07 00:02:26.705 DEBUG 1 --- [uster-worker-14] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-07 00:02:26.708 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] Connection established, initializing transport 2021-07-07 00:02:27.647 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-07 00:02:27.662 DEBUG 1 --- [uster-worker-14] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 0 new connections, total = 1 2021-07-07 00:02:27.663 DEBUG 1 --- [uster-worker-14] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.30.195:9042 (1 connections needed, 1 successfully opened) 2021-07-07 00:02:27.663 DEBUG 1 --- [uster-worker-14] com.datastax.driver.core.Session : Added connection pool for /10.242.30.195:9042 2021-07-07 00:02:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:02:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:02:56.705 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:02:56.707 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:03:26.707 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:03:26.785 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:03:31.747 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:03:31.753 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:03:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:03:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:03:51.884 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:03:51.886 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:03:56.786 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:03:56.787 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:04:06.985 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:04:06.987 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:04:26.787 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:04:26.789 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:04:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:04:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:04:56.789 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:04:56.792 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:04:56.795 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:04:56.797 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:05:12.245 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:05:12.255 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:05:26.792 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:05:26.802 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:05:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:05:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:05:56.802 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:05:56.804 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:06:00.004 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:06:00.007 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : Started cron job dataGroomingCleanup @ 20210707 2021-07-07 00:06:00.011 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The logDir is /opt/app/aai-graphadmin/logs 2021-07-07 00:06:00.011 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The dataGroomingDir is /opt/app/aai-graphadmin/logs/data/dataGrooming 2021-07-07 00:06:00.011 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The archiveDir is /opt/app/aai-graphadmin/logs/data/dataGrooming/ARCHIVE 2021-07-07 00:06:00.012 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The dataGroomingArcDir is /opt/app/aai-graphadmin/logs/data/dataGrooming/ARCHIVE/dataGrooming 2021-07-07 00:06:00.012 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : Directory/opt/app/aai-graphadmin/logsexists: true 2021-07-07 00:06:00.014 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The current date is Wed Jul 07 00:06:00 GMT 2021 2021-07-07 00:06:00.014 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The newAgeDate is Fri Jul 02 00:06:00 GMT 2021 2021-07-07 00:06:00.015 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The current date is Wed Jul 07 00:06:00 GMT 2021 2021-07-07 00:06:00.015 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The newAgeDate is Mon Jun 07 00:06:00 GMT 2021 2021-07-07 00:06:00.015 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : Ended cron job dataGroomingCleanup @ 20210707 2021-07-07 00:06:00.016 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:06:02.696 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:06:02.698 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:06:26.804 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:06:26.806 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:06:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:06:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:06:32.699 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:06:32.700 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:06:35.347 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:06:35.358 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=1, closed=false] heartbeat query succeeded 2021-07-07 00:06:55.400 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:06:55.401 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:06:56.806 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:06:56.808 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:07:02.701 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:07:02.702 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:07:25.402 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:07:25.404 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:07:26.808 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:07:26.810 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:07:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:07:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:07:51.941 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:07:54.488 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.30.195:9042, scheduling delivery 2021-07-07 00:07:54.488 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event DOWN 2021-07-07 00:07:55.489 DEBUG 1 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.30.195:9042 because it still has active connections 2021-07-07 00:07:59.063 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [980975200-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1ef1bdbb at consistency LOCAL_QUORUM 2021-07-07 00:07:59.066 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [980975200-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-07 00:07:59.843 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:08:01.986 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:08:01.988 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:08:04.257 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] Response received on stream 5248 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ROWS [4 columns] --- 2021-07-07 00:08:10.089 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.30.195:9042, scheduling delivery 2021-07-07 00:08:10.090 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event UP 2021-07-07 00:08:11.091 DEBUG 1 --- [uster-worker-15] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.30.195:9042 2021-07-07 00:08:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:08:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:08:34.090 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:08:34.092 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:08:41.096 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:08:41.098 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:09:04.092 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:09:04.094 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:09:11.098 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:09:11.100 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:09:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:09:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:09:39.604 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.30.195:9042, scheduling delivery 2021-07-07 00:09:39.604 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event DOWN 2021-07-07 00:09:40.605 DEBUG 1 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.30.195:9042 because it still has active connections 2021-07-07 00:09:40.990 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.30.195:9042, scheduling delivery 2021-07-07 00:09:40.990 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event UP 2021-07-07 00:09:41.992 DEBUG 1 --- [uster-worker-16] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.30.195:9042 2021-07-07 00:09:42.678 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:09:42.683 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:10:11.995 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:10:11.997 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:10:24.047 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:10:24.053 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:10:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:10:32.658 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:10:41.997 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:10:41.999 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:11:11.999 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:11:12.001 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:11:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:11:32.660 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:11:42.001 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:11:42.085 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:11:48.789 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:11:48.800 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:12:12.085 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:12:12.087 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:12:18.801 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:12:18.802 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:12:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:12:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:12:39.795 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:12:39.797 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:12:42.087 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:12:42.088 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:13:12.088 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:13:12.090 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:13:30.485 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:13:30.487 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:13:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:13:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:13:42.090 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:13:42.092 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:14:00.494 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:14:00.496 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:14:10.263 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [464410596-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7ed80474 at consistency LOCAL_QUORUM 2021-07-07 00:14:10.264 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [464410596-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-07 00:14:12.092 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:14:12.100 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:14:19.089 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] Response received on stream 6976 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ROWS [4 columns] --- 2021-07-07 00:14:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:14:32.662 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:14:42.100 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:14:42.102 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:14:59.105 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:14:59.185 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:15:12.102 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:15:12.185 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:15:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:15:32.660 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:15:35.053 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:15:36.369 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:15:42.185 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:15:42.186 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:16:12.187 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:16:12.190 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:16:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:16:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:16:42.190 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:16:42.192 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:17:00.002 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:17:00.003 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : Started cron job dataSnapshotCleanup @ 20210707 2021-07-07 00:17:00.003 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The logDir is /opt/app/aai-graphadmin/logs 2021-07-07 00:17:00.003 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The dataSnapshotDir is /opt/app/aai-graphadmin/logs/data/dataSnapshots 2021-07-07 00:17:00.004 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The archiveDir is /opt/app/aai-graphadmin/logs/data/dataSnapshots/ARCHIVE 2021-07-07 00:17:00.004 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The dataSnapshotArcDir is /opt/app/aai-graphadmin/logs/data/dataSnapshots/ARCHIVE/dataSnapshots 2021-07-07 00:17:00.004 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : Directory/opt/app/aai-graphadmin/logsexists: true 2021-07-07 00:17:00.005 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The current date is Wed Jul 07 00:17:00 GMT 2021 2021-07-07 00:17:00.006 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The newAgeDate is Fri Jul 02 00:17:00 GMT 2021 2021-07-07 00:17:00.007 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P4 2021-07-07 00:17:00.013 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.013 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P10 2021-07-07 00:17:00.013 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.014 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P1 2021-07-07 00:17:00.014 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.014 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P13 2021-07-07 00:17:00.014 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.015 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P8 2021-07-07 00:17:00.015 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.015 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P14 2021-07-07 00:17:00.016 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.016 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P6 2021-07-07 00:17:00.017 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.017 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P12 2021-07-07 00:17:00.017 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.017 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P0 2021-07-07 00:17:00.018 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.018 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P2 2021-07-07 00:17:00.018 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.018 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P5 2021-07-07 00:17:00.019 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.019 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P3 2021-07-07 00:17:00.019 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.019 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P11 2021-07-07 00:17:00.019 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.020 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P7 2021-07-07 00:17:00.020 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.020 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The file name in dataSnapshot: dataSnapshot.graphSON.202107062345.P9 2021-07-07 00:17:00.020 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The fileCreateDate in dataSnapshot is Tue Jul 06 00:00:00 GMT 2021 2021-07-07 00:17:00.021 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The current date is Wed Jul 07 00:17:00 GMT 2021 2021-07-07 00:17:00.021 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The newAgeDate is Mon Jun 07 00:17:00 GMT 2021 2021-07-07 00:17:00.021 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : Started dmaapEventsDataCleanup @ 20210707 2021-07-07 00:17:00.021 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The logDir is /opt/app/aai-graphadmin/logs 2021-07-07 00:17:00.021 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : The dmaapEventsDataDir is /opt/app/aai-graphadmin/logs/data/dmaapEvents 2021-07-07 00:17:00.022 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : Ended cron dmaapEventsDataCleanup @ 20210707 2021-07-07 00:17:00.052 ERROR 1 --- [ scheduling-1] org.onap.aai.logging.ErrorLogHelper : ERR.5.4.4000 ex=org.onap.aai.exceptions.AAIException: Exception running cron job for DataCleanupex=org.onap.aai.exceptions.AAIException: Property key aai.datamigration.agedelete cannot be found ClassName- org.onap.aai.util.AAIConfig :LineNumber- 157 :MethodName- get ClassName- org.onap.aai.util.AAIConfig :LineNumber- 175 :MethodName- getInt ClassName- org.onap.aai.datacleanup.DataCleanupTasks :LineNumber- 343 :MethodName- dataMigrationCleanup ClassName- org.onap.aai.datacleanup.DataCleanupTasks :LineNumber- 297 :MethodName- dataSnapshotCleanup ClassName- sun.reflect.NativeMethodAccessorImpl :LineNumber- -2 :MethodName- invoke0 ClassName- sun.reflect.NativeMethodAccessorImpl :LineNumber- 62 :MethodName- invoke ClassName- sun.reflect.DelegatingMethodAccessorImpl :LineNumber- 43 :MethodName- invoke ClassName- java.lang.reflect.Method :LineNumber- 498 :MethodName- invoke ClassName- org.springframework.scheduling.support.ScheduledMethodRunnable :LineNumber- 84 :MethodName- run ClassName- org.springframework.scheduling.support.DelegatingErrorHandlingRunnable :LineNumber- 54 :MethodName- run ClassName- org.onap.aai.logging.ErrorLogHelper :LineNumber- 616 :MethodName- logError ClassName- org.onap.aai.datacleanup.DataCleanupTasks :LineNumber- 300 :MethodName- dataSnapshotCleanup ClassName- sun.reflect.NativeMethodAccessorImpl :LineNumber- -2 :MethodName- invoke0 ClassName- sun.reflect.NativeMethodAccessorImpl :LineNumber- 62 :MethodName- invoke ClassName- sun.reflect.DelegatingMethodAccessorImpl :LineNumber- 43 :MethodName- invoke ClassName- java.lang.reflect.Method :LineNumber- 498 :MethodName- invoke ClassName- org.springframework.scheduling.support.ScheduledMethodRunnable :LineNumber- 84 :MethodName- run ClassName- org.springframework.scheduling.support.DelegatingErrorHandlingRunnable :LineNumber- 54 :MethodName- run ClassName- org.springframework.scheduling.concurrent.ReschedulingRunnable :LineNumber- 93 :MethodName- run ClassName- java.util.concurrent.Executors$RunnableAdapter :LineNumber- 511 :MethodName- call 2021-07-07 00:17:00.052 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : AAI_4000 2021-07-07 00:17:00.071 DEBUG 1 --- [ scheduling-1] o.onap.aai.datacleanup.DataCleanupTasks : Ended cron job dataSnapshotCleanup @ 20210707 2021-07-07 00:17:00.072 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:17:03.596 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:17:03.598 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:17:12.192 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:17:12.194 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:17:12.992 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.30.195:9042, scheduling delivery 2021-07-07 00:17:12.992 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event DOWN 2021-07-07 00:17:13.993 DEBUG 1 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.30.195:9042 because it still has active connections 2021-07-07 00:17:16.463 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.30.195:9042, scheduling delivery 2021-07-07 00:17:16.463 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event UP 2021-07-07 00:17:17.464 DEBUG 1 --- [uster-worker-17] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.30.195:9042 2021-07-07 00:17:18.786 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:17:18.787 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:17:32.652 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:17:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:17:44.042 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:17:47.470 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:17:47.472 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:17:49.085 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:17:49.086 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:17:51.163 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1080369739-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27bfe3cd at consistency LOCAL_QUORUM 2021-07-07 00:17:51.164 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1080369739-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-07 00:17:52.043 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:17:52.241 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] Response received on stream 7872 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ROWS [4 columns] --- 2021-07-07 00:17:56.090 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.30.195:9042, scheduling delivery 2021-07-07 00:17:56.091 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event DOWN 2021-07-07 00:17:57.091 DEBUG 1 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.30.195:9042 because it still has active connections 2021-07-07 00:18:22.241 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:18:22.253 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:18:26.091 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:18:26.092 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:18:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:18:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:18:34.251 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-07T00:18:20Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 23 common frames omitted 2021-07-07 00:18:46.283 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:18:46.284 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:18:56.092 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:18:56.094 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:18:59.844 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-07T00:18:43.786Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 23 common frames omitted 2021-07-07 00:19:14.289 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:19:14.291 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:19:26.094 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:19:26.096 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:19:29.842 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:19:31.882 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:19:32.652 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:19:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:19:42.366 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [788883907-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f1bba74 at consistency null 2021-07-07 00:19:42.366 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [788883907-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-07 00:19:56.096 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:19:56.098 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:20:01.887 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.30.195:9042, scheduling delivery 2021-07-07 00:20:01.887 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event UP 2021-07-07 00:20:02.889 DEBUG 1 --- [uster-worker-18] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.30.195:9042 2021-07-07 00:20:12.367 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:20:13.758 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:20:17.390 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:20:17.391 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:20:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:20:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:20:32.892 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:20:32.895 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:20:34.563 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [604167921-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6ac01d44 at consistency LOCAL_QUORUM 2021-07-07 00:20:34.564 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [604167921-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-07 00:20:35.441 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] Response received on stream 8384 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ROWS [4 columns] --- 2021-07-07 00:20:47.497 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:20:47.584 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:21:02.895 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:21:02.898 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:21:16.605 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.30.195:9042, scheduling delivery 2021-07-07 00:21:16.606 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event DOWN 2021-07-07 00:21:16.971 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1905024317-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@794f79c2 at consistency LOCAL_QUORUM 2021-07-07 00:21:16.972 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1905024317-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-07 00:21:17.585 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:21:17.586 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:21:17.607 DEBUG 1 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.30.195:9042 because it still has active connections 2021-07-07 00:21:19.797 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:21:31.863 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-13, inFlight=1, closed=false] because: [/10.242.30.195:9042] Heartbeat query timed out 2021-07-07 00:21:31.863 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preventing new connections for the next 1000 ms 2021-07-07 00:21:31.863 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-13, inFlight=1, closed=false] failed, remaining = 0 2021-07-07 00:21:31.864 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=1, closed=true] closing connection 2021-07-07 00:21:31.864 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.30.195:9042-13, inFlight=1, closed=true]: there are still pending requests 2021-07-07 00:21:31.864 DEBUG 1 --- [uster-worker-19] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] marking host DOWN 2021-07-07 00:21:31.865 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2126273576-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@75b31f1b at consistency LOCAL_QUORUM 2021-07-07 00:21:31.865 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2126273576-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.TransportException: [/10.242.30.195:9042] Connection has been closed 2021-07-07 00:21:31.868 DEBUG 1 --- [uster-worker-19] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-07-07 00:21:31.868 DEBUG 1 --- [uster-worker-19] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] starting reconnection attempt 2021-07-07 00:21:32.656 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:21:32.660 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:21:32.868 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-07 00:21:32.870 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-14, inFlight=0, closed=false] Connection established, initializing transport 2021-07-07 00:21:44.963 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-14, inFlight=0, closed=false] because: [/10.242.30.195:9042] Operation timed out 2021-07-07 00:21:44.964 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-14, inFlight=0, closed=false] failed, remaining = 0 2021-07-07 00:21:44.964 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-14, inFlight=0, closed=true] closing connection 2021-07-07 00:21:44.965 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.30.195:9042-14, inFlight=0, closed=true]: there are still pending requests 2021-07-07 00:21:44.965 DEBUG 1 --- [uster-worker-20] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-07 00:21:44.965 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.30.195:9042 ([/10.242.30.195:9042] Operation timed out), scheduling retry in 2000 milliseconds 2021-07-07 00:21:44.965 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 2000 ms 2021-07-07 00:21:46.607 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:21:46.608 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:21:46.965 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-07 00:21:46.967 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-15, inFlight=0, closed=false] Connection established, initializing transport 2021-07-07 00:21:56.521 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-13, inFlight=0, closed=true] has already terminated 2021-07-07 00:22:04.863 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-15, inFlight=0, closed=false] because: [/10.242.30.195:9042] Operation timed out 2021-07-07 00:22:04.863 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-15, inFlight=0, closed=false] failed, remaining = 0 2021-07-07 00:22:04.864 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-15, inFlight=0, closed=true] closing connection 2021-07-07 00:22:04.864 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.30.195:9042-15, inFlight=0, closed=true]: there are still pending requests 2021-07-07 00:22:04.864 DEBUG 1 --- [uster-worker-21] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-07 00:22:04.864 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.30.195:9042 ([/10.242.30.195:9042] Operation timed out), scheduling retry in 4000 milliseconds 2021-07-07 00:22:04.865 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 4000 ms 2021-07-07 00:22:08.865 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-07 00:22:08.867 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-16, inFlight=0, closed=false] Connection established, initializing transport 2021-07-07 00:22:11.521 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-14, inFlight=0, closed=true] has already terminated 2021-07-07 00:22:11.891 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:22:11.892 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:22:16.608 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:22:16.609 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:22:20.964 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-16, inFlight=0, closed=false] because: [/10.242.30.195:9042] Operation timed out 2021-07-07 00:22:20.964 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-16, inFlight=0, closed=false] failed, remaining = 0 2021-07-07 00:22:20.965 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-16, inFlight=0, closed=true] closing connection 2021-07-07 00:22:20.965 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.30.195:9042-16, inFlight=0, closed=true]: there are still pending requests 2021-07-07 00:22:20.965 DEBUG 1 --- [uster-worker-22] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-07 00:22:20.966 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.30.195:9042 ([/10.242.30.195:9042] Operation timed out), scheduling retry in 8000 milliseconds 2021-07-07 00:22:20.966 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 8000 ms 2021-07-07 00:22:28.966 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-07 00:22:28.968 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-17, inFlight=0, closed=false] Connection established, initializing transport 2021-07-07 00:22:30.254 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.30.195:9042-17, inFlight=0, closed=false] because: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-07 00:22:30.254 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-17, inFlight=0, closed=false] failed, remaining = 0 2021-07-07 00:22:30.254 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-17, inFlight=0, closed=true] closing connection 2021-07-07 00:22:30.254 DEBUG 1 --- [uster-worker-21] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.30.195:9042 2021-07-07 00:22:30.255 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-17, inFlight=0, closed=true] has already terminated 2021-07-07 00:22:30.255 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-07 00:22:30.256 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.30.195:9042, scheduling retry in 16000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.30.195:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-07 00:22:30.257 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] next reconnection attempt in 16000 ms 2021-07-07 00:22:32.653 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:22:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:22:41.522 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-15, inFlight=0, closed=true] has already terminated 2021-07-07 00:22:42.799 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.30.195:9042, scheduling delivery 2021-07-07 00:22:42.799 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] received event UP 2021-07-07 00:22:43.800 DEBUG 1 --- [uster-worker-22] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.30.195:9042 2021-07-07 00:22:43.889 DEBUG 1 --- [uster-worker-22] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] marking host UP 2021-07-07 00:22:43.889 DEBUG 1 --- [uster-worker-22] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP 2021-07-07 00:22:43.889 DEBUG 1 --- [uster-worker-22] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.30.195:9042 2021-07-07 00:22:43.890 DEBUG 1 --- [uster-worker-22] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 1 new connections, total = 1 2021-07-07 00:22:43.892 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-18, inFlight=0, closed=false] Connection established, initializing transport 2021-07-07 00:22:47.646 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] Connection[/10.242.30.195:9042-18, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-07 00:22:47.654 DEBUG 1 --- [uster-worker-22] com.datastax.driver.core.Host.STATES : [/10.242.30.195:9042] preparing to open 0 new connections, total = 1 2021-07-07 00:22:47.654 DEBUG 1 --- [uster-worker-22] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.30.195:9042 (1 connections needed, 1 successfully opened) 2021-07-07 00:22:47.654 DEBUG 1 --- [uster-worker-22] com.datastax.driver.core.Session : Added connection pool for /10.242.30.195:9042 2021-07-07 00:22:56.523 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-16, inFlight=0, closed=true] has already terminated 2021-07-07 00:23:04.464 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1356158022-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3ec84aed at consistency LOCAL_QUORUM 2021-07-07 00:23:04.464 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1356158022-0] Error querying /10.242.30.195:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.30.195:9042] Timed out waiting for server response 2021-07-07 00:23:12.162 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-18, inFlight=0, closed=false] Response received on stream 3648 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses. 2021-07-07 00:23:13.887 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:23:13.889 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:23:17.393 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:23:17.394 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:23:32.654 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:23:32.657 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:23:39.489 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:23:39.491 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:23:43.889 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:23:43.890 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:23:52.370 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-07T00:23:41.519Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 0 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 23 common frames omitted 2021-07-07 00:24:13.890 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:24:13.892 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:24:22.367 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:24:22.441 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.30.195:9042-18, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:24:32.655 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-07-07 00:24:32.658 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-07-07 00:24:43.892 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:24:43.894 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.60.71:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-07-07 00:24:57.498 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-07-07 00:24:57.584 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.181.80:9042-1, inFlight=0, closed=false] heartbeat query succeeded