By type
Project Build Version: 1.0.0 2021-08-11 15:54:11.926 INFO --- [ main] org.onap.aai.util.AAIConfig : Initializing AAIConfig 2021-08-11 15:54:11.934 DEBUG --- [ main] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-graphadmin/./resources/etc/appprops/aaiconfig.properties 2021-08-11 15:54:11.934 INFO --- [ main] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-graphadmin/./resources/etc/appprops/aaiconfig.properties 2021-08-11 15:54:11.937 INFO --- [ main] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename 2021-08-11 15:54:13.699 WARN 1 --- [ main] o.s.b.l.logback.LogbackLoggingSystem : Ignoring 'logback.configurationFile' system property. Please use 'logging.config' instead. . ____ _ __ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' |____| .__|_| |_|_| |_\__, | / / / / =========|_|==============|___/=/_/_/_/ :: Spring Boot :: (v2.1.12.RELEASE) 2021-08-11 15:54:14.175 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : Starting GraphAdminApp on aai-graphadmin with PID 1 (/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar started by aaiadmin in /opt/app/aai-graphadmin) 2021-08-11 15:54:14.175 DEBUG 1 --- [ main] org.onap.aai.GraphAdminApp : Running with Spring Boot v2.1.12.RELEASE, Spring v5.1.13.RELEASE 2021-08-11 15:54:14.176 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : The following profiles are active: dmaap,one-way-ssl 15:54:18,911 |-INFO in LogbackRequestLog - Will use configuration resource [/localhost-access-logback.xml] 15:54:18,921 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - debug attribute not set 15:54:18,921 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender] 15:54:18,921 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS] 15:54:18,922 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1678046232 - No compression will be used 15:54:18,922 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1678046232 - Will use the pattern /opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd} for the active file 15:54:18,923 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - The date pattern is 'yyyy-MM-dd' from file name pattern '/opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd}'. 15:54:18,923 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Roll-over at midnight. 15:54:18,923 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Setting initial period to Wed Aug 11 15:54:18 GMT 2021 15:54:18,944 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - Active log file name: /opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log 15:54:18,944 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - File property is set to [/opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log] 15:54:18,945 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS] to null 15:54:18,945 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - End of configuration. 15:54:18,945 |-INFO in ch.qos.logback.access.joran.JoranConfigurator@3e11f9e9 - Registering current configuration as safe fallback point 2021-08-11 15:54:19.206 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/lib/aai-els-onap-logging-1.8.1.jar!/ 2021-08-11 15:54:19.293 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 86 ms to scan 1 urls, producing 6 keys and 6 values 2021-08-11 15:54:19.300 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/classes!/ 2021-08-11 15:54:19.323 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 23 ms to scan 1 urls, producing 7 keys and 53 values 2021-08-11 15:54:19.360 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/lib/aai-els-onap-logging-1.8.1.jar!/ 2021-08-11 15:54:19.366 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 6 ms to scan 1 urls, producing 6 keys and 6 values 2021-08-11 15:54:19.371 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/classes!/ 2021-08-11 15:54:19.388 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 16 ms to scan 1 urls, producing 7 keys and 53 values 2021-08-11 15:54:19.398 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/lib/aai-els-onap-logging-1.8.1.jar!/ 2021-08-11 15:54:19.403 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 5 ms to scan 1 urls, producing 6 keys and 6 values 2021-08-11 15:54:19.409 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/classes!/ 2021-08-11 15:54:19.422 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 13 ms to scan 1 urls, producing 7 keys and 53 values 2021-08-11 15:54:19.875 INFO 1 --- [ main] org.onap.aai.config.NodesConfiguration : Translator is SchemaServiceTranslator 2021-08-11 15:54:20.311 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:20.311 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:20.311 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:20.313 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:20.321 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/versions, BODY= 2021-08-11 15:54:20.552 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:20.552 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:20.552 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:20.553 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:21.027 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:21.138 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Processing the translator 2021-08-11 15:54:21.138 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv11 2021-08-11 15:54:21.139 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:21.241 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:21.241 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:21.241 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:21.241 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:21.274 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:21.327 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:21.327 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:21.327 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:24.846 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 222 2021-08-11 15:54:24.887 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv12 2021-08-11 15:54:24.888 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:24.890 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:24.890 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:24.890 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:24.890 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:24.929 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:24.956 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:24.957 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:24.957 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:26.339 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 235 2021-08-11 15:54:26.386 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv13 2021-08-11 15:54:26.387 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:26.389 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:26.389 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:26.389 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:26.389 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:26.510 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:26.546 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:26.547 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:26.548 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:27.928 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 237 2021-08-11 15:54:27.943 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv14 2021-08-11 15:54:27.944 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:27.945 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:27.945 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:27.945 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:27.946 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:27.969 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:27.989 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:27.990 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:27.990 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:29.680 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 272 2021-08-11 15:54:29.694 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv15 2021-08-11 15:54:29.694 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:29.696 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:29.696 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:29.696 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:29.696 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:29.951 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:29.989 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:29.990 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:29.991 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:31.519 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 279 2021-08-11 15:54:31.532 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv16 2021-08-11 15:54:31.532 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:31.534 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:31.534 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:31.534 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:31.534 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:31.561 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:31.588 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:31.589 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:31.589 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:33.319 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281 2021-08-11 15:54:33.372 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv17 2021-08-11 15:54:33.373 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:33.375 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:33.376 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:33.376 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:33.376 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:33.405 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:33.428 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:33.428 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:33.429 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:34.970 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281 2021-08-11 15:54:34.982 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv18 2021-08-11 15:54:34.982 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:34.984 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:34.984 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:34.984 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:34.984 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:35.045 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:35.078 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:35.078 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:35.079 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:36.437 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281 2021-08-11 15:54:36.477 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv19 2021-08-11 15:54:36.477 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:36.479 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:36.479 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:36.479 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:36.479 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:36.497 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:36.519 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:36.520 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:36.520 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:38.229 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 301 2021-08-11 15:54:38.241 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv20 2021-08-11 15:54:38.242 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:38.244 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:38.244 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:38.244 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:38.244 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:38.273 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:38.300 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:38.301 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:38.301 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:40.012 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 305 2021-08-11 15:54:40.023 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv21 2021-08-11 15:54:40.024 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:40.026 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:40.026 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:40.026 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:40.026 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:40.093 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:40.120 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:40.120 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:40.121 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:41.944 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 371 2021-08-11 15:54:41.960 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv22 2021-08-11 15:54:41.960 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:41.962 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:41.962 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:41.962 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:41.963 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:41.988 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:42.021 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:42.022 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:42.022 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:43.947 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378 2021-08-11 15:54:43.988 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv23 2021-08-11 15:54:43.990 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-08-11 15:54:43.993 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:43.993 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:43.993 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:43.994 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:44.125 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:44.159 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:44.160 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-08-11 15:54:44.161 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-08-11 15:54:45.900 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378 2021-08-11 15:54:46.013 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.013 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.013 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.015 INFO 1 --- [ main] o.onap.aai.rest.client.ApertureService : Successfully initialized the aperture service 2021-08-11 15:54:46.199 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Processing the translator 2021-08-11 15:54:46.201 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv11 2021-08-11 15:54:46.201 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.202 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v11, BODY= 2021-08-11 15:54:46.203 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.203 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.203 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.203 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.214 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.216 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.216 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.217 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv12 2021-08-11 15:54:46.217 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.217 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v12, BODY= 2021-08-11 15:54:46.218 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.218 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.218 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.218 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.231 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.232 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.233 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.233 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv13 2021-08-11 15:54:46.234 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.234 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v13, BODY= 2021-08-11 15:54:46.235 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.235 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.235 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.235 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.248 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.252 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.252 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.253 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv14 2021-08-11 15:54:46.254 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.255 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v14, BODY= 2021-08-11 15:54:46.257 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.257 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.257 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.257 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.272 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.276 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.276 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.277 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv15 2021-08-11 15:54:46.278 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.279 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v15, BODY= 2021-08-11 15:54:46.280 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.281 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.281 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.281 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.292 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.296 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.297 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.297 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv16 2021-08-11 15:54:46.298 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.298 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v16, BODY= 2021-08-11 15:54:46.300 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.300 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.300 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.300 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.311 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.315 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.315 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.316 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv17 2021-08-11 15:54:46.316 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.317 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v17, BODY= 2021-08-11 15:54:46.319 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.319 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.319 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.319 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.331 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.335 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.335 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.336 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv18 2021-08-11 15:54:46.336 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.337 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v18, BODY= 2021-08-11 15:54:46.339 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.339 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.339 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.339 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.350 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.354 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.354 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.355 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv19 2021-08-11 15:54:46.355 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.356 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v19, BODY= 2021-08-11 15:54:46.357 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.357 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.357 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.358 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.370 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.376 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.377 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.378 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv20 2021-08-11 15:54:46.378 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.379 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v20, BODY= 2021-08-11 15:54:46.382 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.382 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.382 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.382 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.394 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.400 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.401 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.401 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv21 2021-08-11 15:54:46.402 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.403 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v21, BODY= 2021-08-11 15:54:46.405 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.405 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.405 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.405 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.419 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.427 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.428 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.428 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv22 2021-08-11 15:54:46.429 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.430 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v22, BODY= 2021-08-11 15:54:46.432 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.432 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.432 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.432 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.448 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.455 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.456 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.456 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv23 2021-08-11 15:54:46.457 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-08-11 15:54:46.458 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v23, BODY= 2021-08-11 15:54:46.460 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-08-11 15:54:46.460 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-08-11 15:54:46.460 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-08-11 15:54:46.460 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-08-11 15:54:46.475 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-08-11 15:54:46.483 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-08-11 15:54:46.483 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-08-11 15:54:46.859 WARN 1 --- [ main] o.apache.activemq.broker.BrokerService : Memory Usage for the Broker (1024mb) is more than the maximum available for the JVM: 972 mb - resetting to 70% of maximum available: 680 mb 2021-08-11 15:54:48.113 INFO 1 --- [ main] com.datastax.driver.core : DataStax Java driver 3.6.0 for Apache Cassandra 2021-08-11 15:54:48.125 INFO 1 --- [ main] c.d.driver.core.GuavaCompatibility : Detected Guava >= 19 in the classpath, using modern compatibility layer 2021-08-11 15:54:48.126 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NEW_NODE_DELAY_SECONDS is undefined, using default value 1 2021-08-11 15:54:48.126 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NOTIF_LOCK_TIMEOUT_SECONDS is undefined, using default value 60 2021-08-11 15:54:48.178 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true 2021-08-11 15:54:48.470 INFO 1 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps. 2021-08-11 15:54:48.473 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NON_BLOCKING_EXECUTOR_SIZE is undefined, using default value 2 2021-08-11 15:54:48.551 WARN 1 --- [ main] .b.a.g.t.GroovyTemplateAutoConfiguration : Cannot find template location: classpath:/templates/ (please add some templates, check your Groovy configuration, or set spring.groovy.template.check-template-location=false) 2021-08-11 15:54:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 15:54:49.317 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 15:54:51.679 WARN 1 --- [ main] org.glassfish.jersey.internal.Errors : The following warnings have been detected: WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.onap.aai.rest.AuditSqlDbConsumer.executeAudit(java.lang.String,java.lang.String,javax.ws.rs.core.HttpHeaders,javax.ws.rs.core.UriInfo), should not consume any entity. 2021-08-11 15:54:51.883 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : Started GraphAdminApp in 39.634 seconds (JVM running for 41.817) 2021-08-11 15:54:51.886 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : Application 'aai-graphadmin' is running on 8449! 2021-08-11 15:54:52.463 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true 2021-08-11 15:54:52.463 INFO 1 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps. 2021-08-11 15:54:52.463 DEBUG 1 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.242.154.72:9042] 2021-08-11 15:54:52.504 DEBUG 1 --- [ main] i.n.u.i.logging.InternalLoggerFactory : Using SLF4J as the default logging framework 2021-08-11 15:54:52.566 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : -Dio.netty.noUnsafe: false 2021-08-11 15:54:52.567 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : Java version: 8 2021-08-11 15:54:52.571 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.theUnsafe: available 2021-08-11 15:54:52.572 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.copyMemory: available 2021-08-11 15:54:52.574 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Buffer.address: available 2021-08-11 15:54:52.576 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : direct buffer constructor: available 2021-08-11 15:54:52.578 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Bits.unaligned: available, true 2021-08-11 15:54:52.578 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9 2021-08-11 15:54:52.579 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.DirectByteBuffer.(long, int): available 2021-08-11 15:54:52.579 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : sun.misc.Unsafe: available 2021-08-11 15:54:52.580 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.tmpdir: /tmp (java.io.tmpdir) 2021-08-11 15:54:52.580 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.bitMode: 64 (sun.arch.data.model) 2021-08-11 15:54:52.585 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.noPreferDirect: false 2021-08-11 15:54:52.585 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.maxDirectMemory: 1020067840 bytes 2021-08-11 15:54:52.585 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.uninitializedArrayAllocationThreshold: -1 2021-08-11 15:54:52.587 DEBUG 1 --- [ main] io.netty.util.internal.CleanerJava6 : java.nio.ByteBuffer.cleaner(): available 2021-08-11 15:54:52.605 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FORCE_NIO is undefined, using default value false 2021-08-11 15:54:52.614 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.workdir: /tmp (io.netty.tmpdir) 2021-08-11 15:54:52.623 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library 'netty_transport_native_epoll_x86_64', trying other loading mechanism. java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) at java.lang.Runtime.loadLibrary0(Runtime.java:870) at java.lang.System.loadLibrary(System.java:1122) at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:263) at java.security.AccessController.doPrivileged(Native Method) at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:255) at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:233) at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:124) at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287) at io.netty.channel.epoll.Native. (Native.java:69) at io.netty.channel.epoll.Epoll. (Epoll.java:33) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at com.datastax.driver.core.NettyUtil. (NettyUtil.java:57) at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95) at com.datastax.driver.core.Connection$Factory. (Connection.java:926) at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499) at com.datastax.driver.core.Cluster.init(Cluster.java:208) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355) at com.datastax.driver.core.Cluster.connect(Cluster.java:305) at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272) at org.janusgraph.diskstorage.cql.CQLStoreManager. (CQLStoreManager.java:165) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58) at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477) at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409) at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration. (GraphDatabaseConfiguration.java:1382) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113) at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:73) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:54) at org.onap.aai.dbmap.AAIGraph$Helper. (AAIGraph.java:80) at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94) at org.onap.aai.GraphAdminApp.main(GraphAdminApp.java:135) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:595) 2021-08-11 15:54:52.624 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : netty_transport_native_epoll_x86_64 cannot be loaded from java.libary.path, now trying export to -Dio.netty.native.workdir: /tmp java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) at java.lang.Runtime.loadLibrary0(Runtime.java:870) at java.lang.System.loadLibrary(System.java:1122) at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38) at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:243) at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:124) at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287) at io.netty.channel.epoll.Native. (Native.java:69) at io.netty.channel.epoll.Epoll. (Epoll.java:33) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at com.datastax.driver.core.NettyUtil. (NettyUtil.java:57) at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95) at com.datastax.driver.core.Connection$Factory. (Connection.java:926) at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499) at com.datastax.driver.core.Cluster.init(Cluster.java:208) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355) at com.datastax.driver.core.Cluster.connect(Cluster.java:305) at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272) at org.janusgraph.diskstorage.cql.CQLStoreManager. (CQLStoreManager.java:165) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58) at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477) at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409) at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration. (GraphDatabaseConfiguration.java:1382) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113) at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:73) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:54) at org.onap.aai.dbmap.AAIGraph$Helper. (AAIGraph.java:80) at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94) at org.onap.aai.GraphAdminApp.main(GraphAdminApp.java:135) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:595) Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) at java.lang.Runtime.loadLibrary0(Runtime.java:870) at java.lang.System.loadLibrary(System.java:1122) at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:263) at java.security.AccessController.doPrivileged(Native Method) at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:255) at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:233) ... 41 common frames omitted 2021-08-11 15:54:52.656 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : Successfully loaded the library /tmp/libnetty_transport_native_epoll_x86_642543671695682895187.so 2021-08-11 15:54:52.662 DEBUG 1 --- [ main] io.netty.util.NetUtil : Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) 2021-08-11 15:54:52.664 DEBUG 1 --- [ main] io.netty.util.NetUtil : /proc/sys/net/core/somaxconn: 128 2021-08-11 15:54:52.665 INFO 1 --- [ main] com.datastax.driver.core.NettyUtil : Found Netty's native epoll transport in the classpath, using it 2021-08-11 15:54:52.711 DEBUG 1 --- [ main] i.n.channel.MultithreadEventLoopGroup : -Dio.netty.eventLoopThreads: 4 2021-08-11 15:54:52.757 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : org.jctools-core.MpscChunkedArrayQueue: available 2021-08-11 15:54:52.774 DEBUG 1 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.level: simple 2021-08-11 15:54:52.774 DEBUG 1 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.targetRecords: 4 2021-08-11 15:54:52.775 DEBUG 1 --- [ main] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@9214725 2021-08-11 15:54:52.787 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.EXTENDED_PEER_CHECK is undefined, using default value true 2021-08-11 15:54:52.911 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.154.72:9042] preparing to open 1 new connections, total = 1 2021-08-11 15:54:52.918 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.DISABLE_COALESCING is undefined, using default value false 2021-08-11 15:54:52.918 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_SCHEDULE_PERIOD_NS is undefined, using default value 10000 2021-08-11 15:54:52.918 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_RUN_WITHOUT_WORK_TIMES is undefined, using default value 5 2021-08-11 15:54:52.933 DEBUG 1 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 2021-08-11 15:54:52.933 DEBUG 1 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 2021-08-11 15:54:52.990 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numHeapArenas: 4 2021-08-11 15:54:52.990 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numDirectArenas: 4 2021-08-11 15:54:52.990 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.pageSize: 8192 2021-08-11 15:54:52.990 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxOrder: 11 2021-08-11 15:54:52.990 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.chunkSize: 16777216 2021-08-11 15:54:52.990 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.tinyCacheSize: 512 2021-08-11 15:54:52.990 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.smallCacheSize: 256 2021-08-11 15:54:52.990 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.normalCacheSize: 64 2021-08-11 15:54:52.990 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxCachedBufferCapacity: 32768 2021-08-11 15:54:52.990 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.cacheTrimInterval: 8192 2021-08-11 15:54:52.990 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.useCacheForAllThreads: true 2021-08-11 15:54:53.077 DEBUG 1 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.allocator.type: unpooled 2021-08-11 15:54:53.077 DEBUG 1 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.threadLocalDirectBufferSize: 65536 2021-08-11 15:54:53.077 DEBUG 1 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.maxThreadLocalCharBufferSize: 16384 2021-08-11 15:54:53.155 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 15:54:53.205 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxCapacity.default: 32768 2021-08-11 15:54:53.206 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxSharedCapacityFactor: 2 2021-08-11 15:54:53.206 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.linkCapacity: 16 2021-08-11 15:54:53.206 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.ratio: 8 2021-08-11 15:54:53.218 DEBUG 1 --- [er-nio-worker-0] io.netty.buffer.AbstractByteBuf : -Dio.netty.buffer.bytebuf.checkAccessible: true 2021-08-11 15:54:53.219 DEBUG 1 --- [er-nio-worker-0] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@31bec904 2021-08-11 15:54:53.237 DEBUG 1 --- [er-nio-worker-0] c.datastax.driver.core.SystemProperties : com.datastax.driver.NATIVE_TRANSPORT_MAX_FRAME_SIZE_IN_MB is undefined, using default value 256 2021-08-11 15:54:53.447 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.154.72:9042] Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 15:54:53.451 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map 2021-08-11 15:54:53.562 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema 2021-08-11 15:54:53.687 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:54:53.697 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 9 milliseconds 2021-08-11 15:54:53.710 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.242.154.72:9042 2021-08-11 15:54:53.710 INFO 1 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor) 2021-08-11 15:54:53.712 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.184.131:9042 added 2021-08-11 15:54:53.712 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.242.154.72:9042 added 2021-08-11 15:54:53.712 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.110.137:9042 added 2021-08-11 15:54:53.717 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.CHECK_IO_DEADLOCKS is undefined, using default value true 2021-08-11 15:54:53.723 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 15:54:53.725 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 15:54:53.732 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.154.72:9042] preparing to open 1 new connections, total = 2 2021-08-11 15:54:53.733 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 15:54:53.734 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 15:54:53.735 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 15:54:53.951 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.154.72:9042] Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 15:54:53.954 DEBUG 1 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.242.154.72:9042 (1 connections needed, 1 successfully opened) 2021-08-11 15:54:53.954 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Session : Added connection pool for cassandra/10.242.154.72:9042 2021-08-11 15:54:54.562 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 15:54:54.562 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.184.131:9042 (1 connections needed, 1 successfully opened) 2021-08-11 15:54:54.562 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.242.184.131:9042 2021-08-11 15:54:54.966 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 15:54:54.966 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.110.137:9042 (1 connections needed, 1 successfully opened) 2021-08-11 15:54:54.966 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.242.110.137:9042 2021-08-11 15:54:55.523 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls: file:/opt/app/aai-graphadmin/resources/ 2021-08-11 15:54:55.526 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/addmanualdata/README in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.526 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/addmanualdata/README in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.526 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.526 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.526 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.527 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.527 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.527 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.527 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/dynamic.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.527 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/dynamic.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.527 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/datatoolscrons.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.528 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/datatoolscrons.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.528 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.528 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.528 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-migration.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.528 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-migration.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.528 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.528 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.528 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.529 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.529 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.529 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.529 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.529 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.530 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.530 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.530 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.530 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.530 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.531 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.531 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.531 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.532 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.532 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.532 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.532 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.532 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.532 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.533 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.533 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.533 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.533 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.533 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.533 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.534 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.534 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.534 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.534 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.534 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.534 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.535 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.535 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.535 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.535 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.535 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.535 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.536 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.536 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.536 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.536 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.537 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.537 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.537 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.537 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.537 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.537 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.538 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.538 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.538 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.538 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.539 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.539 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.539 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.539 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.539 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.539 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.539 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.539 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.540 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.540 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.540 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.540 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.540 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.540 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.541 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.541 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.541 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.541 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.541 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.541 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.541 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.542 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.542 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.542 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.542 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.542 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.542 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.542 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.543 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.543 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.543 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.543 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.543 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.543 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.543 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.544 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.544 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.544 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.544 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.544 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.545 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.545 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.545 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.545 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.545 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.545 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.545 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.545 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.546 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.546 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.546 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.546 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.546 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.547 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.547 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.547 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.547 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.547 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.547 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.547 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.547 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.548 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.548 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.548 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.548 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.548 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.548 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.548 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.549 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.549 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.549 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.549 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.549 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.549 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.549 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.550 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.550 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.550 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.550 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.550 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.550 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.550 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.550 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.550 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.551 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.551 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.551 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.551 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.551 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.551 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.551 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.551 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.552 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.552 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.552 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.552 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.552 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.552 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.552 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.552 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.552 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.553 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.553 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.553 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.553 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.553 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.553 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.553 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.554 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.554 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.554 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.554 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.554 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.554 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.554 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.554 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.554 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.555 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.555 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.555 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.555 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.555 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.555 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.555 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.556 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dynamicPayloadGenerator-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.556 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dynamicPayloadGenerator-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.556 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file forceDelete-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.556 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file forceDelete-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.556 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file updatePropertyTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.556 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file updatePropertyTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.556 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.556 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.557 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.557 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.557 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.557 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.557 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file org/janusgraph/graphdb/configuration/janusgraph.internal.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.558 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file org/janusgraph/graphdb/configuration/janusgraph.internal.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.558 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schemaMod-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.558 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schemaMod-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.558 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.558 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.558 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dupeTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.558 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dupeTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.558 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file migration-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.558 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file migration-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.558 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file uniquePropertyCheck-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.559 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file uniquePropertyCheck-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.559 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-08-11 15:54:55.559 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-08-11 15:54:55.559 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 36 ms to scan 1 urls, producing 0 keys and 0 values 2021-08-11 15:54:55.853 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=true] closing connection 2021-08-11 15:54:55.853 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-1, inFlight=0, closed=true] closed, remaining = 0 2021-08-11 15:54:55.858 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=true] closing connection 2021-08-11 15:54:55.858 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.154.72:9042] Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=true] closed, remaining = 1 2021-08-11 15:54:55.858 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=true] closing connection 2021-08-11 15:54:55.858 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-1, inFlight=0, closed=true] closed, remaining = 0 2021-08-11 15:54:55.873 DEBUG 1 --- [ main] com.datastax.driver.core.Cluster : Shutting down 2021-08-11 15:54:55.875 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=true] closing connection 2021-08-11 15:54:55.875 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.154.72:9042] Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=true] closed, remaining = 0 2021-08-11 15:54:58.101 DEBUG 1 --- [er-nio-worker-0] io.netty.buffer.PoolThreadCache : Freed 38 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-0 2021-08-11 15:54:58.102 DEBUG 1 --- [er-nio-worker-2] io.netty.buffer.PoolThreadCache : Freed 21 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-2 2021-08-11 15:54:58.120 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true 2021-08-11 15:54:58.121 INFO 1 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps. 2021-08-11 15:54:58.121 DEBUG 1 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.242.154.72:9042] 2021-08-11 15:54:58.125 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.154.72:9042] preparing to open 1 new connections, total = 1 2021-08-11 15:54:58.128 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 15:54:58.265 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.154.72:9042] Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 15:54:58.265 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map 2021-08-11 15:54:58.274 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema 2021-08-11 15:54:58.321 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:54:58.329 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 8 milliseconds 2021-08-11 15:54:58.340 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.242.154.72:9042 2021-08-11 15:54:58.341 INFO 1 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor) 2021-08-11 15:54:58.341 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.184.131:9042 added 2021-08-11 15:54:58.341 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.242.154.72:9042 added 2021-08-11 15:54:58.341 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.110.137:9042 added 2021-08-11 15:54:58.341 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 15:54:58.342 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.154.72:9042] preparing to open 1 new connections, total = 2 2021-08-11 15:54:58.342 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 15:54:58.344 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 15:54:58.372 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 15:54:58.373 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 15:54:58.472 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.154.72:9042] Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 15:54:58.473 DEBUG 1 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.242.154.72:9042 (1 connections needed, 1 successfully opened) 2021-08-11 15:54:58.473 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Session : Added connection pool for cassandra/10.242.154.72:9042 2021-08-11 15:54:58.614 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 15:54:58.615 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.184.131:9042 (1 connections needed, 1 successfully opened) 2021-08-11 15:54:58.615 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.242.184.131:9042 2021-08-11 15:54:59.876 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 15:54:59.876 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.110.137:9042 (1 connections needed, 1 successfully opened) 2021-08-11 15:54:59.876 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.242.110.137:9042 2021-08-11 15:55:01.078 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : GraphAdmin MicroService Started 2021-08-11 15:55:01.078 DEBUG 1 --- [ main] org.onap.aai.GraphAdminApp : GraphAdmin MicroService Started GraphAdmin Microservice Started 2021-08-11 15:55:28.293 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:55:28.348 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:55:30.875 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:55:30.879 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:55:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 15:55:49.317 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 15:55:58.349 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:55:58.353 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:56:06.262 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:56:06.265 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:56:28.353 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:56:28.369 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:56:31.336 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:56:31.339 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:56:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 15:56:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 15:56:58.369 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:56:58.372 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:57:26.470 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:57:26.475 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:57:28.372 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:57:28.447 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:57:41.487 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:57:41.489 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:57:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 15:57:49.318 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 15:57:51.190 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED KEYSPACE dox, scheduling delivery 2021-08-11 15:57:52.081 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED KEYSPACE zusammen_dox, scheduling delivery 2021-08-11 15:57:52.345 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED KEYSPACE workflow, scheduling delivery 2021-08-11 15:57:53.354 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null) 2021-08-11 15:57:53.416 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:57:53.424 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 7 milliseconds 2021-08-11 15:57:53.683 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED KEYSPACE zusammen_workflow, scheduling delivery 2021-08-11 15:57:54.069 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TYPE dox.version, scheduling delivery 2021-08-11 15:57:55.070 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null) 2021-08-11 15:57:55.124 DEBUG 1 --- [luster-worker-3] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:57:55.136 DEBUG 1 --- [luster-worker-3] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 12 milliseconds 2021-08-11 15:57:56.476 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:57:56.478 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:57:56.778 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE workflow.unique_value, scheduling delivery 2021-08-11 15:57:57.160 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TYPE dox.user_candidate_version, scheduling delivery 2021-08-11 15:57:58.160 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null) 2021-08-11 15:57:58.209 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:57:58.220 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 11 milliseconds 2021-08-11 15:57:58.618 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.item, scheduling delivery 2021-08-11 15:57:58.980 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.version_info, scheduling delivery 2021-08-11 15:57:59.981 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null) 2021-08-11 15:58:00.002 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.version, scheduling delivery 2021-08-11 15:58:00.018 DEBUG 1 --- [luster-worker-3] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:58:00.030 DEBUG 1 --- [luster-worker-3] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 12 milliseconds 2021-08-11 15:58:00.855 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.version_info_deleted, scheduling delivery 2021-08-11 15:58:01.148 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.version_elements, scheduling delivery 2021-08-11 15:58:02.148 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null) 2021-08-11 15:58:02.183 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:58:02.193 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 10 milliseconds 2021-08-11 15:58:02.684 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.unique_value, scheduling delivery 2021-08-11 15:58:03.552 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element_namespace, scheduling delivery 2021-08-11 15:58:03.953 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.package_details, scheduling delivery 2021-08-11 15:58:04.628 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_enriched_service_template, scheduling delivery 2021-08-11 15:58:04.851 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element, scheduling delivery 2021-08-11 15:58:05.747 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element_synchronization_state, scheduling delivery 2021-08-11 15:58:06.704 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element_stage, scheduling delivery 2021-08-11 15:58:07.705 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null) 2021-08-11 15:58:07.741 DEBUG 1 --- [luster-worker-3] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:58:07.753 DEBUG 1 --- [luster-worker-3] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 12 milliseconds 2021-08-11 15:58:08.530 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.version_stage, scheduling delivery 2021-08-11 15:58:08.803 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_enriched_service_artifact, scheduling delivery 2021-08-11 15:58:09.694 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.application_config, scheduling delivery 2021-08-11 15:58:10.695 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null) 2021-08-11 15:58:10.738 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:58:10.749 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 11 milliseconds 2021-08-11 15:58:10.777 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.action, scheduling delivery 2021-08-11 15:58:11.655 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery 2021-08-11 15:58:12.656 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE) 2021-08-11 15:58:12.891 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery 2021-08-11 15:58:13.818 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery 2021-08-11 15:58:14.819 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE) 2021-08-11 15:58:15.658 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery 2021-08-11 15:58:16.529 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:58:16.534 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:58:16.659 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE) 2021-08-11 15:58:16.809 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery 2021-08-11 15:58:17.810 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE) 2021-08-11 15:58:18.572 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.ecompcomponent, scheduling delivery 2021-08-11 15:58:19.572 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.ecompcomponent (TABLE) 2021-08-11 15:58:20.558 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery 2021-08-11 15:58:21.559 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE) 2021-08-11 15:58:21.798 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.action_artifact, scheduling delivery 2021-08-11 15:58:22.799 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action_artifact (TABLE) 2021-08-11 15:58:23.762 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.activity_log, scheduling delivery 2021-08-11 15:58:24.762 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.activity_log (TABLE) 2021-08-11 15:58:25.647 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.healing, scheduling delivery 2021-08-11 15:58:26.649 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.healing (TABLE) 2021-08-11 15:58:27.156 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.migration, scheduling delivery 2021-08-11 15:58:28.156 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.migration (TABLE) 2021-08-11 15:58:28.356 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.item_permissions, scheduling delivery 2021-08-11 15:58:29.356 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.item_permissions (TABLE) 2021-08-11 15:58:29.665 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.user_permission_items, scheduling delivery 2021-08-11 15:58:30.666 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.user_permission_items (TABLE) 2021-08-11 15:58:30.893 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.notification_subscribers, scheduling delivery 2021-08-11 15:58:31.894 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.notification_subscribers (TABLE) 2021-08-11 15:58:31.955 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.last_notification, scheduling delivery 2021-08-11 15:58:32.956 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.last_notification (TABLE) 2021-08-11 15:58:33.481 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.notifications, scheduling delivery 2021-08-11 15:58:34.482 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.notifications (TABLE) 2021-08-11 15:58:34.799 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_merge_hint, scheduling delivery 2021-08-11 15:58:35.788 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.item, scheduling delivery 2021-08-11 15:58:36.624 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version, scheduling delivery 2021-08-11 15:58:37.633 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null) 2021-08-11 15:58:37.674 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:58:37.680 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds 2021-08-11 15:58:37.875 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version_elements, scheduling delivery 2021-08-11 15:58:38.876 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.version_elements (TABLE) 2021-08-11 15:58:38.906 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_namespace, scheduling delivery 2021-08-11 15:58:39.645 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element, scheduling delivery 2021-08-11 15:58:40.646 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox 2021-08-11 15:58:40.652 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:58:40.662 DEBUG 1 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 10 milliseconds 2021-08-11 15:58:40.923 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_synchronization_state, scheduling delivery 2021-08-11 15:58:41.666 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_stage, scheduling delivery 2021-08-11 15:58:42.667 DEBUG 1 --- [luster-worker-3] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox 2021-08-11 15:58:42.675 DEBUG 1 --- [luster-worker-3] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan. 2021-08-11 15:58:42.680 DEBUG 1 --- [luster-worker-3] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 5 milliseconds 2021-08-11 15:58:42.709 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version_stage, scheduling delivery 2021-08-11 15:58:43.710 DEBUG 1 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.version_stage (TABLE) 2021-08-11 15:58:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 15:58:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 15:59:06.625 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:59:06.628 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:59:13.713 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:59:13.714 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:59:36.681 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:59:36.685 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:59:43.715 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:59:43.717 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 15:59:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 15:59:49.317 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 15:59:56.748 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 15:59:56.751 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:00:13.717 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:00:13.719 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:00:16.773 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:00:16.775 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:00:21.782 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:00:21.785 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:00:43.720 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:00:43.722 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:00:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:00:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:01:01.826 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:01:01.828 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:01:13.722 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:01:13.725 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:01:36.872 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:01:36.876 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:01:43.726 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:01:43.728 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:01:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:01:49.318 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:02:13.729 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:02:13.731 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:02:26.984 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:02:27.047 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=1, closed=false] heartbeat query succeeded 2021-08-11 16:02:43.732 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:02:43.734 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:02:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:02:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:03:07.059 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:03:07.063 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:03:13.735 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:03:13.747 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:03:42.263 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:03:42.267 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:03:43.748 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:03:43.756 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:03:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:03:49.318 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:04:13.756 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:04:13.758 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:04:17.303 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:04:17.305 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:04:22.346 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:04:22.349 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:04:43.759 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:04:43.761 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:04:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:04:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:05:12.399 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:05:12.403 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:05:13.762 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:05:13.764 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:05:27.457 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:05:27.460 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:05:43.764 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:05:43.768 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:05:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:05:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:05:52.485 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:05:52.488 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:06:13.768 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:06:13.771 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:06:22.489 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:06:22.562 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:06:27.579 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:06:27.582 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:06:43.771 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:06:43.773 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:06:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:06:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:06:52.656 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:06:52.658 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:07:13.774 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:07:13.776 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:07:17.678 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:07:17.680 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:07:43.777 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:07:43.780 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:07:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:07:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:07:57.778 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:07:57.782 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:08:13.780 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:08:13.782 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:08:27.868 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:08:27.870 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:08:37.878 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:08:37.881 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:08:43.782 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:08:43.784 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:08:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:08:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:09:13.784 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:09:13.787 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:09:43.787 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:09:43.791 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:09:49.320 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:09:49.323 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:09:58.148 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:09:58.161 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:10:13.792 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:10:13.794 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:10:43.794 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:10:43.797 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:10:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:10:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:11:13.310 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:11:13.313 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:11:13.797 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:11:13.799 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:11:23.363 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:11:23.366 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:11:43.800 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:11:43.804 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:11:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:11:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:11:53.393 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:11:53.396 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:12:13.804 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:12:13.806 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:12:38.487 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:12:38.490 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:12:43.812 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:12:43.815 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:12:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:12:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:12:59.260 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.184.131:9042, scheduling delivery 2021-08-11 16:12:59.261 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] received event DOWN 2021-08-11 16:12:59.263 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] connection error io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer at io.netty.channel.unix.FileDescriptor.readAddress(..)(Unknown Source) 2021-08-11 16:12:59.264 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] because: [/10.242.184.131:9042] Unexpected exception triggered (io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer) 2021-08-11 16:12:59.269 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preventing new connections for the next 1000 ms 2021-08-11 16:12:59.269 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-1, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:12:59.272 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-1, inFlight=0, closed=true] closing connection 2021-08-11 16:12:59.273 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] marking host DOWN 2021-08-11 16:12:59.286 DEBUG 1 --- [luster-worker-4] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-08-11 16:12:59.286 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] starting reconnection attempt 2021-08-11 16:13:00.064 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] connection error io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer at io.netty.channel.unix.FileDescriptor.readAddress(..)(Unknown Source) 2021-08-11 16:13:00.064 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] because: [/10.242.110.137:9042] Unexpected exception triggered (io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer) 2021-08-11 16:13:00.065 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preventing new connections for the next 1000 ms 2021-08-11 16:13:00.065 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-1, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:13:00.066 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-1, inFlight=0, closed=true] closing connection 2021-08-11 16:13:00.066 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] marking host DOWN 2021-08-11 16:13:00.067 DEBUG 1 --- [luster-worker-5] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-08-11 16:13:00.067 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] starting reconnection attempt 2021-08-11 16:13:00.248 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.110.137:9042, scheduling delivery 2021-08-11 16:13:00.248 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] received event DOWN 2021-08-11 16:13:00.286 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:13:00.290 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-2, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:13:00.293 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-2, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:13:00.293 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-2, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:13:00.293 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-2, inFlight=0, closed=true] closing connection 2021-08-11 16:13:00.293 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:13:00.294 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-08-11 16:13:00.294 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 2000 ms 2021-08-11 16:13:01.067 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:13:01.070 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-2, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:13:01.070 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-2, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:13:01.070 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-2, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:13:01.070 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-2, inFlight=0, closed=true] closing connection 2021-08-11 16:13:01.071 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:13:01.071 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-08-11 16:13:01.073 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 2000 ms 2021-08-11 16:13:01.250 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:13:01.250 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:13:02.295 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:13:02.298 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-3, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:13:02.298 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-3, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:13:02.298 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-3, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:13:02.299 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-3, inFlight=0, closed=true] closing connection 2021-08-11 16:13:02.299 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:13:02.300 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 4000 milliseconds 2021-08-11 16:13:02.300 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 4000 ms 2021-08-11 16:13:03.073 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:13:03.075 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-3, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:13:03.076 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-3, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:13:03.076 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-3, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:13:03.076 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-3, inFlight=0, closed=true] closing connection 2021-08-11 16:13:03.076 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:13:03.078 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 4000 milliseconds 2021-08-11 16:13:03.078 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 4000 ms 2021-08-11 16:13:03.655 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2113591901-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5aa145ee at consistency null 2021-08-11 16:13:03.656 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2113591901-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:03.736 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [16641153-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4ce69270 at consistency null 2021-08-11 16:13:03.736 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [16641153-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:03.790 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1092457353-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@8cfb1f6 at consistency null 2021-08-11 16:13:03.790 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1092457353-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:03.894 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1569845712-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@22160013 at consistency null 2021-08-11 16:13:03.894 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1569845712-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:03.998 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [436457181-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7248af8a at consistency null 2021-08-11 16:13:03.998 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [436457181-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:04.102 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1970643192-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ac5c6a1 at consistency null 2021-08-11 16:13:04.102 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1970643192-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:04.205 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1490678788-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7f70960e at consistency null 2021-08-11 16:13:04.205 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1490678788-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:04.408 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [169120190-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6d74176b at consistency null 2021-08-11 16:13:04.409 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [169120190-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:04.612 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [249942791-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5a77d1b0 at consistency null 2021-08-11 16:13:04.613 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [249942791-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:04.816 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1448067139-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7e23e491 at consistency null 2021-08-11 16:13:04.817 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1448067139-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:05.020 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1101100890-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2c04efd8 at consistency null 2021-08-11 16:13:05.021 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1101100890-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:05.224 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1863747505-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4de281a5 at consistency null 2021-08-11 16:13:05.224 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1863747505-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:05.427 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1330322623-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ed45891 at consistency null 2021-08-11 16:13:05.427 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1330322623-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:05.631 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1739489485-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@143d27fc at consistency null 2021-08-11 16:13:05.631 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1739489485-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:06.035 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [771694789-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1f4c708c at consistency null 2021-08-11 16:13:06.035 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [771694789-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:06.300 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:13:06.302 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-4, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:13:06.302 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-4, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:13:06.302 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-4, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:13:06.302 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-4, inFlight=0, closed=true] closing connection 2021-08-11 16:13:06.302 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:13:06.303 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 8000 milliseconds 2021-08-11 16:13:06.303 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 8000 ms 2021-08-11 16:13:06.439 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1980699076-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@467a3569 at consistency null 2021-08-11 16:13:06.439 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1980699076-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:06.842 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1639339358-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6ac6ede7 at consistency null 2021-08-11 16:13:06.843 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1639339358-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:07.078 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:13:07.081 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-4, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:13:07.081 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-4, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:13:07.081 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-4, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:13:07.081 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-4, inFlight=0, closed=true] closing connection 2021-08-11 16:13:07.081 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:13:07.082 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 8000 milliseconds 2021-08-11 16:13:07.082 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 8000 ms 2021-08-11 16:13:07.646 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1921849677-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6b8defff at consistency null 2021-08-11 16:13:07.646 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1921849677-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:07.650 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:12:58.068Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:13:12.657 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [639694545-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7c4b5e9a at consistency null 2021-08-11 16:13:12.657 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [639694545-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:12.685 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [682578656-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@21bf3d21 at consistency null 2021-08-11 16:13:12.685 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [682578656-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:12.738 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2069954062-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7ff43997 at consistency null 2021-08-11 16:13:12.739 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2069954062-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:12.842 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1639827294-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7b82c381 at consistency null 2021-08-11 16:13:12.842 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1639827294-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:12.945 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1082799046-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5d9bfde5 at consistency null 2021-08-11 16:13:12.945 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1082799046-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:13.148 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [308302181-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5958542 at consistency null 2021-08-11 16:13:13.148 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [308302181-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:13.552 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1854692777-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5bf32ce6 at consistency null 2021-08-11 16:13:13.552 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1854692777-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:14.303 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:13:14.306 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-5, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:13:14.306 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-5, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:13:14.306 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-5, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:13:14.307 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-5, inFlight=0, closed=true] closing connection 2021-08-11 16:13:14.307 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:13:14.308 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 16000 milliseconds 2021-08-11 16:13:14.308 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 16000 ms 2021-08-11 16:13:14.355 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1627713553-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@360062d2 at consistency null 2021-08-11 16:13:14.356 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1627713553-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:15.082 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:13:15.086 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-5, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:13:15.086 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-5, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:13:15.087 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-5, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:13:15.087 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-5, inFlight=0, closed=true] closing connection 2021-08-11 16:13:15.087 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:13:15.088 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 16000 milliseconds 2021-08-11 16:13:15.088 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 16000 ms 2021-08-11 16:13:15.159 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1879178228-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3476d522 at consistency null 2021-08-11 16:13:15.160 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1879178228-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:15.161 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:12:58.068Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:13:20.168 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1618638824-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1de0e97b at consistency null 2021-08-11 16:13:20.168 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1618638824-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:20.196 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1821839195-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5f36723d at consistency null 2021-08-11 16:13:20.197 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1821839195-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:20.250 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [718663328-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6a958dfb at consistency null 2021-08-11 16:13:20.250 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [718663328-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:20.303 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1442082389-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@68489a4e at consistency null 2021-08-11 16:13:20.303 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1442082389-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:20.356 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1719830068-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@72790d0d at consistency null 2021-08-11 16:13:20.356 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1719830068-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:20.459 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [842772584-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1eb22ee5 at consistency null 2021-08-11 16:13:20.460 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [842772584-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:20.563 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [924776545-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@588e929d at consistency null 2021-08-11 16:13:20.563 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [924776545-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:20.666 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1106161169-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7438e928 at consistency null 2021-08-11 16:13:20.666 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1106161169-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:20.869 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [858727230-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4e1393c7 at consistency null 2021-08-11 16:13:20.870 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [858727230-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:21.073 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1551400387-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@41d959e6 at consistency null 2021-08-11 16:13:21.073 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1551400387-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:21.476 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [484793309-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6def313a at consistency null 2021-08-11 16:13:21.477 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [484793309-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:22.281 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [684712054-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5e2de406 at consistency null 2021-08-11 16:13:22.281 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [684712054-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:23.886 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1647513730-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@c72d9af at consistency null 2021-08-11 16:13:23.886 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1647513730-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:23.889 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:12:58.068Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:13:28.951 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1261926571-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7efa7ae at consistency null 2021-08-11 16:13:28.951 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1261926571-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:29.047 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [472710635-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@139d3088 at consistency null 2021-08-11 16:13:29.047 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [472710635-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:29.151 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1717651948-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2221fb29 at consistency null 2021-08-11 16:13:29.151 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1717651948-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:29.355 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1275784125-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3804e163 at consistency null 2021-08-11 16:13:29.355 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1275784125-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:29.558 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1015554231-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@422cf31a at consistency null 2021-08-11 16:13:29.559 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1015554231-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:29.962 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1194348904-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@384f92a7 at consistency null 2021-08-11 16:13:29.962 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1194348904-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:30.248 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:13:30.250 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:13:30.308 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:13:30.311 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-6, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:13:30.311 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-6, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:13:30.311 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-6, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:13:30.312 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-6, inFlight=0, closed=true] closing connection 2021-08-11 16:13:30.312 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:13:30.312 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 32000 milliseconds 2021-08-11 16:13:30.312 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 32000 ms 2021-08-11 16:13:30.366 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [737300043-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@159ade34 at consistency null 2021-08-11 16:13:30.366 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [737300043-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:31.088 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:13:31.090 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-6, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:13:31.091 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-6, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:13:31.091 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-6, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:13:31.091 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-6, inFlight=0, closed=true] closing connection 2021-08-11 16:13:31.091 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:13:31.092 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 32000 milliseconds 2021-08-11 16:13:31.092 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 32000 ms 2021-08-11 16:13:31.169 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [809377675-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2f9bac65 at consistency null 2021-08-11 16:13:31.170 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [809377675-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:32.776 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1296964771-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6b05c99b at consistency null 2021-08-11 16:13:32.777 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1296964771-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:32.778 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:12:58.068Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:13:37.784 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [145801075-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@28adc1b1 at consistency null 2021-08-11 16:13:37.784 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [145801075-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:37.847 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [831072312-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@732c5c7b at consistency null 2021-08-11 16:13:37.848 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [831072312-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:37.946 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1896594373-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1a63eff at consistency null 2021-08-11 16:13:37.947 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1896594373-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:38.000 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1285360195-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@442a7641 at consistency null 2021-08-11 16:13:38.000 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1285360195-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:38.053 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1096515460-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2cc973c at consistency null 2021-08-11 16:13:38.053 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1096515460-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:38.147 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [963336063-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1392dc9a at consistency null 2021-08-11 16:13:38.147 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [963336063-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:38.250 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [353502724-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@237359d1 at consistency null 2021-08-11 16:13:38.250 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [353502724-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:38.454 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [838457847-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@34fcbb80 at consistency null 2021-08-11 16:13:38.454 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [838457847-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:38.658 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [734275347-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@52efbf54 at consistency null 2021-08-11 16:13:38.658 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [734275347-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:39.062 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1224166843-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@579ccf9f at consistency null 2021-08-11 16:13:39.062 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1224166843-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:39.866 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1297105031-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6e98a96c at consistency null 2021-08-11 16:13:39.867 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1297105031-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:41.471 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [848891579-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f692f84 at consistency null 2021-08-11 16:13:41.472 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [848891579-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:13:41.473 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:12:58.068Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:13:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:13:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:13:55.449 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.184.131:9042, scheduling delivery 2021-08-11 16:13:55.449 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] received event UP 2021-08-11 16:13:56.451 DEBUG 1 --- [luster-worker-5] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.184.131:9042 2021-08-11 16:13:56.456 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] marking host UP 2021-08-11 16:13:56.457 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP 2021-08-11 16:13:56.458 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.184.131:9042 2021-08-11 16:13:56.458 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:13:56.461 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-7, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 16:13:59.064 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.110.137:9042, scheduling delivery 2021-08-11 16:13:59.064 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] received event UP 2021-08-11 16:14:00.065 DEBUG 1 --- [luster-worker-4] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.110.137:9042 2021-08-11 16:14:00.069 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] marking host UP 2021-08-11 16:14:00.069 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP 2021-08-11 16:14:00.069 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.110.137:9042 2021-08-11 16:14:00.069 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:14:00.071 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 16:14:04.264 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 16:14:04.869 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 0 new connections, total = 1 2021-08-11 16:14:04.869 DEBUG 1 --- [luster-worker-4] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.110.137:9042 (1 connections needed, 1 successfully opened) 2021-08-11 16:14:04.872 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Session : Added connection pool for /10.242.110.137:9042 2021-08-11 16:14:07.850 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-7, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 16:14:08.057 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 0 new connections, total = 1 2021-08-11 16:14:08.058 DEBUG 1 --- [luster-worker-5] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.184.131:9042 (1 connections needed, 1 successfully opened) 2021-08-11 16:14:08.058 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Session : Added connection pool for /10.242.184.131:9042 2021-08-11 16:14:30.069 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:14:30.071 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:14:46.571 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:14:46.573 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:14:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:14:49.317 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:15:00.072 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:15:00.074 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:15:16.574 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:15:16.575 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:15:30.074 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:15:30.077 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:15:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:15:49.317 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:16:00.077 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:16:00.079 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:16:16.778 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-7, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:16:16.782 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-7, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:16:30.079 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:16:30.147 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:16:46.889 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-7, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:16:46.891 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-7, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:16:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:16:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:17:00.147 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:17:00.150 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:17:11.964 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:17:11.966 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:17:30.150 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:17:30.153 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:17:42.158 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:17:42.161 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:17:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:17:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:18:00.153 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:18:00.155 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:18:12.161 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:18:12.164 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:18:27.268 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:18:27.270 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:18:30.156 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:18:30.157 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:18:49.319 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:18:49.321 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:19:00.158 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:19:00.160 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:19:30.160 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:19:30.163 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:19:37.472 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:19:37.475 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:19:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:19:49.318 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:20:00.163 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:20:00.166 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:20:07.475 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:20:07.477 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:20:30.166 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:20:30.169 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:20:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:20:49.317 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:20:52.796 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-7, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:20:52.846 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-7, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:20:59.267 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-7, inFlight=0, closed=false] connection error io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer at io.netty.channel.unix.FileDescriptor.readAddress(..)(Unknown Source) 2021-08-11 16:20:59.268 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-7, inFlight=0, closed=false] because: [/10.242.184.131:9042] Unexpected exception triggered (io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer) 2021-08-11 16:20:59.268 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preventing new connections for the next 1000 ms 2021-08-11 16:20:59.268 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-7, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:20:59.269 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-7, inFlight=0, closed=true] closing connection 2021-08-11 16:20:59.270 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] marking host DOWN 2021-08-11 16:20:59.271 DEBUG 1 --- [luster-worker-6] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-08-11 16:20:59.271 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] starting reconnection attempt 2021-08-11 16:20:59.278 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.184.131:9042, scheduling delivery 2021-08-11 16:20:59.278 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] received event DOWN 2021-08-11 16:20:59.867 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.110.137:9042, scheduling delivery 2021-08-11 16:20:59.867 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] received event DOWN 2021-08-11 16:20:59.872 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] connection error io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer at io.netty.channel.unix.FileDescriptor.readAddress(..)(Unknown Source) 2021-08-11 16:20:59.872 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] because: [/10.242.110.137:9042] Unexpected exception triggered (io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer) 2021-08-11 16:20:59.872 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preventing new connections for the next 1000 ms 2021-08-11 16:20:59.873 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-7, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:20:59.873 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-7, inFlight=0, closed=true] closing connection 2021-08-11 16:20:59.873 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] marking host DOWN 2021-08-11 16:20:59.874 DEBUG 1 --- [luster-worker-7] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-08-11 16:20:59.874 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] starting reconnection attempt 2021-08-11 16:21:00.271 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:21:00.273 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-8, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:21:00.273 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-8, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:21:00.274 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-8, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:21:00.274 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-8, inFlight=0, closed=true] closing connection 2021-08-11 16:21:00.274 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:21:00.275 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-08-11 16:21:00.275 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 2000 ms 2021-08-11 16:21:00.868 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:21:00.868 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:21:00.874 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:21:00.877 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-8, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:21:00.877 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-8, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:21:00.877 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-8, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:21:00.877 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-8, inFlight=0, closed=true] closing connection 2021-08-11 16:21:00.877 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:21:00.878 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-08-11 16:21:00.878 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 2000 ms 2021-08-11 16:21:02.275 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:21:02.277 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-9, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:21:02.277 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-9, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:21:02.277 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-9, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:21:02.277 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-9, inFlight=0, closed=true] closing connection 2021-08-11 16:21:02.277 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:21:02.278 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 4000 milliseconds 2021-08-11 16:21:02.278 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 4000 ms 2021-08-11 16:21:02.879 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:21:02.880 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-9, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:21:02.881 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-9, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:21:02.881 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-9, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:21:02.881 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-9, inFlight=0, closed=true] closing connection 2021-08-11 16:21:02.881 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:21:02.882 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 4000 milliseconds 2021-08-11 16:21:02.882 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 4000 ms 2021-08-11 16:21:02.958 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [372640845-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2102f780 at consistency null 2021-08-11 16:21:02.958 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [372640845-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:03.012 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [974285842-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@afaf905 at consistency null 2021-08-11 16:21:03.012 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [974285842-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:03.114 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [199987541-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7c99f2d1 at consistency null 2021-08-11 16:21:03.115 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [199987541-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:03.218 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [428609966-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@75529d52 at consistency null 2021-08-11 16:21:03.218 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [428609966-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:03.321 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1073619638-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@435ada8f at consistency null 2021-08-11 16:21:03.322 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1073619638-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:03.526 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [379956135-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1e352130 at consistency null 2021-08-11 16:21:03.526 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [379956135-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:03.729 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1091825951-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2d09475d at consistency null 2021-08-11 16:21:03.729 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1091825951-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:04.133 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [946571762-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4c50e7a3 at consistency null 2021-08-11 16:21:04.134 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [946571762-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:04.938 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1984882651-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@59cbc204 at consistency null 2021-08-11 16:21:04.938 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1984882651-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:06.278 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:21:06.280 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-10, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:21:06.280 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-10, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:21:06.281 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-10, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:21:06.281 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-10, inFlight=0, closed=true] closing connection 2021-08-11 16:21:06.281 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:21:06.282 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 8000 milliseconds 2021-08-11 16:21:06.282 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 8000 ms 2021-08-11 16:21:06.546 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1301119526-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6ec054ac at consistency null 2021-08-11 16:21:06.547 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1301119526-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:06.548 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:20:57.363Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:21:06.882 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:21:06.884 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-10, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:21:06.884 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-10, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:21:06.885 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-10, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:21:06.885 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-10, inFlight=0, closed=true] closing connection 2021-08-11 16:21:06.885 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:21:06.885 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 8000 milliseconds 2021-08-11 16:21:06.885 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 8000 ms 2021-08-11 16:21:11.555 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [323492225-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@914c586 at consistency null 2021-08-11 16:21:11.555 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [323492225-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:11.584 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2005411331-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@42b246f8 at consistency null 2021-08-11 16:21:11.584 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2005411331-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:11.611 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1996060438-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@456e7748 at consistency null 2021-08-11 16:21:11.611 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1996060438-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:11.639 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1464092509-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@29672e7d at consistency null 2021-08-11 16:21:11.639 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1464092509-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:11.667 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [76793893-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@670e622 at consistency null 2021-08-11 16:21:11.667 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [76793893-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:11.694 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [849174154-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5625e592 at consistency null 2021-08-11 16:21:11.695 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [849174154-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:11.747 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [266460680-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@60c71c29 at consistency null 2021-08-11 16:21:11.748 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [266460680-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:11.851 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2053770758-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@70c3d28a at consistency null 2021-08-11 16:21:11.851 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2053770758-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:12.054 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1621238670-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@71037b46 at consistency null 2021-08-11 16:21:12.054 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1621238670-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:12.257 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [940791838-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@8f30981 at consistency null 2021-08-11 16:21:12.258 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [940791838-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:12.461 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [956551306-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@500d6ae2 at consistency null 2021-08-11 16:21:12.461 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [956551306-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:12.865 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [330560402-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3eb4b5eb at consistency null 2021-08-11 16:21:12.865 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [330560402-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:13.269 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1660685369-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@54073030 at consistency null 2021-08-11 16:21:13.269 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1660685369-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:14.073 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1083014096-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@44a89430 at consistency null 2021-08-11 16:21:14.074 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1083014096-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:14.282 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:21:14.285 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-11, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:21:14.286 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-11, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:21:14.286 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-11, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:21:14.286 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-11, inFlight=0, closed=true] closing connection 2021-08-11 16:21:14.286 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:21:14.287 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 16000 milliseconds 2021-08-11 16:21:14.287 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 16000 ms 2021-08-11 16:21:14.877 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1731028171-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7fc9ac3d at consistency null 2021-08-11 16:21:14.877 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1731028171-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:14.879 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:20:57.363Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:21:14.886 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:21:14.888 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-11, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:21:14.888 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-11, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:21:14.888 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-11, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:21:14.888 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-11, inFlight=0, closed=true] closing connection 2021-08-11 16:21:14.888 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:21:14.889 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 16000 milliseconds 2021-08-11 16:21:14.889 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 16000 ms 2021-08-11 16:21:19.885 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1796093151-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@9a26fdb at consistency null 2021-08-11 16:21:19.886 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1796093151-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:19.914 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1762750531-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@92b73cb at consistency null 2021-08-11 16:21:19.915 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1762750531-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:19.968 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1122620746-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3b318e97 at consistency null 2021-08-11 16:21:19.968 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1122620746-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:20.022 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1315896032-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@15783b66 at consistency null 2021-08-11 16:21:20.022 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1315896032-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:20.075 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1415354174-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@fbe42a5 at consistency null 2021-08-11 16:21:20.075 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1415354174-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:20.128 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [908949150-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5dd9cdb2 at consistency null 2021-08-11 16:21:20.128 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [908949150-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:20.184 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [987936404-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6a2bb5a8 at consistency null 2021-08-11 16:21:20.184 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [987936404-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:20.287 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [56812242-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3edc0080 at consistency null 2021-08-11 16:21:20.287 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [56812242-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:20.491 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [867660007-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@430ad694 at consistency null 2021-08-11 16:21:20.491 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [867660007-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:20.894 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1853061513-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@502d271a at consistency null 2021-08-11 16:21:20.895 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1853061513-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:21.298 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1099572421-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@671c5e42 at consistency null 2021-08-11 16:21:21.299 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1099572421-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:21.703 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1433021012-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2cb145f0 at consistency null 2021-08-11 16:21:21.703 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1433021012-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:22.506 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1565673558-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@159da28b at consistency null 2021-08-11 16:21:22.507 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1565673558-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:22.508 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:20:57.363Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:21:27.513 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [681106756-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@10760034 at consistency null 2021-08-11 16:21:27.514 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [681106756-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:27.547 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [941910174-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7d50db89 at consistency null 2021-08-11 16:21:27.547 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [941910174-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:27.600 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1016646980-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5b688f16 at consistency null 2021-08-11 16:21:27.600 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1016646980-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:27.703 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1942430329-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2319e70a at consistency null 2021-08-11 16:21:27.704 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1942430329-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:27.916 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [500933560-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3ce34fd at consistency null 2021-08-11 16:21:27.916 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [500933560-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:28.119 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [102782981-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@78b93b9e at consistency null 2021-08-11 16:21:28.119 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [102782981-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:28.347 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2083018600-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@bfb91fb at consistency null 2021-08-11 16:21:28.347 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2083018600-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:28.550 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [917923454-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@796025a5 at consistency null 2021-08-11 16:21:28.550 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [917923454-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:28.753 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1991296371-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@48b494dc at consistency null 2021-08-11 16:21:28.753 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1991296371-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:29.156 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1926515664-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1f086d71 at consistency null 2021-08-11 16:21:29.157 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1926515664-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:29.868 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:21:29.869 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:21:29.960 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1283047925-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@48ab5322 at consistency null 2021-08-11 16:21:29.960 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1283047925-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:30.287 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:21:30.289 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-12, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:21:30.290 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-12, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:21:30.290 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-12, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:21:30.290 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-12, inFlight=0, closed=true] closing connection 2021-08-11 16:21:30.290 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:21:30.291 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 32000 milliseconds 2021-08-11 16:21:30.291 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 32000 ms 2021-08-11 16:21:30.763 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1232722834-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@301e0a9f at consistency null 2021-08-11 16:21:30.763 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1232722834-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:30.765 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:20:57.363Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:21:30.889 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:21:30.891 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-12, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:21:30.891 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-12, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:21:30.892 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-12, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:21:30.892 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-12, inFlight=0, closed=true] closing connection 2021-08-11 16:21:30.892 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:21:30.893 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 32000 milliseconds 2021-08-11 16:21:30.893 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 32000 ms 2021-08-11 16:21:35.771 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [965870739-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5ce06a34 at consistency null 2021-08-11 16:21:35.771 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [965870739-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:35.825 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1774736058-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@dff73c at consistency null 2021-08-11 16:21:35.825 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1774736058-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:35.878 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1799110687-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@127f9646 at consistency null 2021-08-11 16:21:35.878 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1799110687-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:35.931 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1822340001-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@52f52c64 at consistency null 2021-08-11 16:21:35.931 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1822340001-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:35.985 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1157727293-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@d9b4dc4 at consistency null 2021-08-11 16:21:35.985 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1157727293-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:36.088 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1853309861-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@72823d5c at consistency null 2021-08-11 16:21:36.088 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1853309861-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:36.191 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1732434636-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1ca158ec at consistency null 2021-08-11 16:21:36.191 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1732434636-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:36.394 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2119728702-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@674cd110 at consistency null 2021-08-11 16:21:36.395 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2119728702-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:36.798 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [934358436-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@306e5550 at consistency null 2021-08-11 16:21:36.798 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [934358436-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:37.647 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1670326940-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5365e6dc at consistency null 2021-08-11 16:21:37.647 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1670326940-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:39.251 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [317327515-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4595b264 at consistency null 2021-08-11 16:21:39.251 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [317327515-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:39.253 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:20:57.363Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:21:44.258 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [796802422-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@44d03f97 at consistency null 2021-08-11 16:21:44.259 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [796802422-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:44.312 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [287111472-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6562688 at consistency null 2021-08-11 16:21:44.312 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [287111472-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:44.365 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [199092805-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7a797398 at consistency null 2021-08-11 16:21:44.365 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [199092805-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:44.468 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1236374901-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1217e821 at consistency null 2021-08-11 16:21:44.468 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1236374901-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:44.572 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [393909432-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@57fe4173 at consistency null 2021-08-11 16:21:44.572 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [393909432-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:21:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:21:49.318 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:21:56.558 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.184.131:9042, scheduling delivery 2021-08-11 16:21:56.558 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] received event UP 2021-08-11 16:21:57.559 DEBUG 1 --- [luster-worker-7] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.184.131:9042 2021-08-11 16:21:57.564 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] marking host UP 2021-08-11 16:21:57.564 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP 2021-08-11 16:21:57.564 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.184.131:9042 2021-08-11 16:21:57.565 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:21:57.567 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-13, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 16:21:59.880 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.110.137:9042, scheduling delivery 2021-08-11 16:21:59.880 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] received event UP 2021-08-11 16:22:00.256 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-13, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 16:22:00.881 DEBUG 1 --- [luster-worker-6] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.110.137:9042 2021-08-11 16:22:00.884 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] marking host UP 2021-08-11 16:22:00.884 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP 2021-08-11 16:22:00.884 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.110.137:9042 2021-08-11 16:22:00.884 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:22:00.886 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 16:22:01.059 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 0 new connections, total = 1 2021-08-11 16:22:01.060 DEBUG 1 --- [luster-worker-7] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.184.131:9042 (1 connections needed, 1 successfully opened) 2021-08-11 16:22:01.060 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Session : Added connection pool for /10.242.184.131:9042 2021-08-11 16:22:04.170 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 16:22:04.372 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 0 new connections, total = 1 2021-08-11 16:22:04.372 DEBUG 1 --- [luster-worker-6] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.110.137:9042 (1 connections needed, 1 successfully opened) 2021-08-11 16:22:04.372 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Session : Added connection pool for /10.242.110.137:9042 2021-08-11 16:22:30.885 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:22:30.887 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:22:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:22:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:23:00.888 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:23:00.891 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:23:05.165 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:23:05.167 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:23:30.891 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:23:30.893 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:23:40.207 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:23:40.210 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:23:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:23:49.317 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:24:00.894 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:24:00.896 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:24:20.248 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:24:20.251 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:24:30.896 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:24:30.898 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:24:35.276 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:24:35.278 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:24:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:24:49.317 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:25:00.898 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:25:00.900 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:25:15.318 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:25:15.320 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:25:30.900 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:25:30.902 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:25:40.380 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:25:40.383 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:25:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:25:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:26:00.903 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:26:00.905 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:26:15.420 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:26:15.423 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:26:30.905 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:26:30.907 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:26:40.459 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:26:40.461 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:26:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:26:49.318 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:27:00.484 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:27:00.562 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:27:00.907 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:27:00.909 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:27:30.909 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:27:30.911 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:27:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:27:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:28:00.753 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:28:00.756 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:28:00.911 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:28:00.913 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:28:30.913 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:28:30.916 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:28:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:28:49.318 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:28:59.249 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-13, inFlight=0, closed=false] connection error io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer at io.netty.channel.unix.FileDescriptor.readAddress(..)(Unknown Source) 2021-08-11 16:28:59.250 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-13, inFlight=0, closed=false] because: [/10.242.184.131:9042] Unexpected exception triggered (io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer) 2021-08-11 16:28:59.250 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preventing new connections for the next 1000 ms 2021-08-11 16:28:59.250 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-13, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:28:59.252 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-13, inFlight=0, closed=true] closing connection 2021-08-11 16:28:59.252 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] marking host DOWN 2021-08-11 16:28:59.253 DEBUG 1 --- [luster-worker-8] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-08-11 16:28:59.253 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] starting reconnection attempt 2021-08-11 16:28:59.352 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.184.131:9042, scheduling delivery 2021-08-11 16:28:59.352 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] received event DOWN 2021-08-11 16:29:00.254 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:29:00.256 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-14, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:29:00.256 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-14, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:29:00.256 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-14, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:29:00.257 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-14, inFlight=0, closed=true] closing connection 2021-08-11 16:29:00.257 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:29:00.257 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-08-11 16:29:00.257 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 2000 ms 2021-08-11 16:29:00.353 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:29:00.662 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] connection error io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer at io.netty.channel.unix.FileDescriptor.readAddress(..)(Unknown Source) 2021-08-11 16:29:00.663 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] because: [/10.242.110.137:9042] Unexpected exception triggered (io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer) 2021-08-11 16:29:00.663 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preventing new connections for the next 1000 ms 2021-08-11 16:29:00.663 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-13, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:29:00.663 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-13, inFlight=0, closed=true] closing connection 2021-08-11 16:29:00.663 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] marking host DOWN 2021-08-11 16:29:00.664 DEBUG 1 --- [luster-worker-9] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-08-11 16:29:00.664 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] starting reconnection attempt 2021-08-11 16:29:00.765 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.110.137:9042, scheduling delivery 2021-08-11 16:29:00.765 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] received event DOWN 2021-08-11 16:29:01.054 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1661447313-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7d76a296 at consistency null 2021-08-11 16:29:01.055 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1661447313-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:01.110 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1044296681-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@26f953d3 at consistency null 2021-08-11 16:29:01.110 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1044296681-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:01.163 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [160528632-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27f692c5 at consistency null 2021-08-11 16:29:01.163 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [160528632-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:01.266 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2047310576-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@315673c2 at consistency null 2021-08-11 16:29:01.266 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2047310576-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:01.369 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [616182277-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@79fc056c at consistency null 2021-08-11 16:29:01.370 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [616182277-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:01.472 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1867545728-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1577b64b at consistency null 2021-08-11 16:29:01.473 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1867545728-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:01.576 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1829015338-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6046e9a at consistency null 2021-08-11 16:29:01.576 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1829015338-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:01.664 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:29:01.666 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-14, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:29:01.667 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-14, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:29:01.667 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-14, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:29:01.667 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-14, inFlight=0, closed=true] closing connection 2021-08-11 16:29:01.667 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:29:01.668 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-08-11 16:29:01.668 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 2000 ms 2021-08-11 16:29:01.679 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [748009600-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1d80677b at consistency null 2021-08-11 16:29:01.679 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [748009600-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:01.766 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:29:01.782 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1506450701-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@35ed5f6e at consistency null 2021-08-11 16:29:01.782 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1506450701-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:01.886 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [890392264-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@10b897f7 at consistency null 2021-08-11 16:29:01.886 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [890392264-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:02.089 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2091317919-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@622be906 at consistency null 2021-08-11 16:29:02.089 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2091317919-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:02.258 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:29:02.259 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-15, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:29:02.260 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-15, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:29:02.260 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-15, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:29:02.260 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-15, inFlight=0, closed=true] closing connection 2021-08-11 16:29:02.260 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:29:02.261 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 4000 milliseconds 2021-08-11 16:29:02.261 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 4000 ms 2021-08-11 16:29:02.492 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2113281075-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7c0ef187 at consistency null 2021-08-11 16:29:02.492 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2113281075-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:02.895 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1884931189-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2347c747 at consistency null 2021-08-11 16:29:02.895 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1884931189-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:03.298 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1461366968-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7794ebf7 at consistency null 2021-08-11 16:29:03.299 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1461366968-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:03.668 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:29:03.670 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-15, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:29:03.670 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-15, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:29:03.671 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-15, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:29:03.671 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-15, inFlight=0, closed=true] closing connection 2021-08-11 16:29:03.671 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:29:03.671 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 4000 milliseconds 2021-08-11 16:29:03.672 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 4000 ms 2021-08-11 16:29:04.102 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [472111814-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4a4a4fda at consistency null 2021-08-11 16:29:04.102 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [472111814-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:04.905 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1375296245-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@41c30ddd at consistency null 2021-08-11 16:29:04.905 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1375296245-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:04.907 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:28:55.547Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:29:06.261 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:29:06.263 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-16, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:29:06.263 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-16, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:29:06.263 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-16, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:29:06.263 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-16, inFlight=0, closed=true] closing connection 2021-08-11 16:29:06.263 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:29:06.263 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 8000 milliseconds 2021-08-11 16:29:06.263 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 8000 ms 2021-08-11 16:29:07.672 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:29:07.674 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-16, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:29:07.674 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-16, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:29:07.674 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-16, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:29:07.674 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-16, inFlight=0, closed=true] closing connection 2021-08-11 16:29:07.675 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:29:07.675 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 8000 milliseconds 2021-08-11 16:29:07.675 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 8000 ms 2021-08-11 16:29:09.913 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1874675411-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@c38146d at consistency null 2021-08-11 16:29:09.913 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1874675411-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:09.966 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1830855916-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1414beaf at consistency null 2021-08-11 16:29:09.967 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1830855916-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:10.019 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1868019300-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4de0f415 at consistency null 2021-08-11 16:29:10.020 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1868019300-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:10.122 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1960998793-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@d390b9b at consistency null 2021-08-11 16:29:10.123 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1960998793-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:10.328 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1911303192-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@416eed2d at consistency null 2021-08-11 16:29:10.328 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1911303192-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:10.731 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [428077325-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@703ed269 at consistency null 2021-08-11 16:29:10.731 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [428077325-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:11.534 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1261801679-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3a34c027 at consistency null 2021-08-11 16:29:11.535 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1261801679-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:12.338 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [739043359-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7f947129 at consistency null 2021-08-11 16:29:12.338 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [739043359-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:13.141 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1007721834-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4925ec73 at consistency null 2021-08-11 16:29:13.141 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1007721834-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:13.143 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:28:55.547Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:29:14.264 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:29:14.266 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-17, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:29:14.267 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-17, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:29:14.267 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-17, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:29:14.267 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-17, inFlight=0, closed=true] closing connection 2021-08-11 16:29:14.267 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:29:14.268 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 16000 milliseconds 2021-08-11 16:29:14.268 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 16000 ms 2021-08-11 16:29:15.676 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:29:15.677 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-17, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:29:15.678 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-17, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:29:15.678 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-17, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:29:15.678 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-17, inFlight=0, closed=true] closing connection 2021-08-11 16:29:15.678 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:29:15.678 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 16000 milliseconds 2021-08-11 16:29:15.679 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 16000 ms 2021-08-11 16:29:18.149 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [983369852-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f0ed2a4 at consistency null 2021-08-11 16:29:18.149 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [983369852-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:18.179 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1565082632-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@53a7069a at consistency null 2021-08-11 16:29:18.179 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1565082632-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:18.232 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [382600110-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@fe628fe at consistency null 2021-08-11 16:29:18.233 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [382600110-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:18.286 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [781006800-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@69c61b05 at consistency null 2021-08-11 16:29:18.286 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [781006800-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:18.389 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2080445589-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@50e47f6b at consistency null 2021-08-11 16:29:18.389 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2080445589-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:18.493 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1811899929-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3b1c203b at consistency null 2021-08-11 16:29:18.493 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1811899929-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:18.596 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [223005627-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5834e7e at consistency null 2021-08-11 16:29:18.596 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [223005627-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:18.799 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1253985909-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5cc473f8 at consistency null 2021-08-11 16:29:18.799 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1253985909-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:19.002 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1055870475-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2f28502c at consistency null 2021-08-11 16:29:19.002 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1055870475-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:19.405 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [783296609-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@756fb00a at consistency null 2021-08-11 16:29:19.406 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [783296609-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:19.810 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1979463967-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6a00f067 at consistency null 2021-08-11 16:29:19.810 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1979463967-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:20.614 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1292438579-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@15a4056c at consistency null 2021-08-11 16:29:20.614 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1292438579-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:20.616 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:28:55.547Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:29:25.648 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [164797583-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@78609ec4 at consistency null 2021-08-11 16:29:25.648 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [164797583-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:25.679 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [638476020-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@70879e22 at consistency null 2021-08-11 16:29:25.679 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [638476020-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:25.747 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [841924587-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1de9db9d at consistency null 2021-08-11 16:29:25.747 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [841924587-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:25.800 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [935548169-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@28532229 at consistency null 2021-08-11 16:29:25.800 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [935548169-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:25.853 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [719880602-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@54b91f59 at consistency null 2021-08-11 16:29:25.853 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [719880602-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:25.947 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2126873549-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1883fd62 at consistency null 2021-08-11 16:29:25.947 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2126873549-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:26.047 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [970172953-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4b65e8dc at consistency null 2021-08-11 16:29:26.047 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [970172953-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:26.151 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [345365303-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7a16c9f3 at consistency null 2021-08-11 16:29:26.151 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [345365303-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:26.354 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2048879726-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6649523f at consistency null 2021-08-11 16:29:26.354 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2048879726-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:26.757 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [672551691-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@61a6db79 at consistency null 2021-08-11 16:29:26.757 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [672551691-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:27.162 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [204580722-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5e1ec99 at consistency null 2021-08-11 16:29:27.162 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [204580722-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:27.965 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [919046560-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4974f487 at consistency null 2021-08-11 16:29:27.966 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [919046560-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:28.847 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [926613258-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@65808f3c at consistency null 2021-08-11 16:29:28.847 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [926613258-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:28.849 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:28:55.547Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:29:30.269 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:29:30.271 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-18, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:29:30.271 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-18, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:29:30.271 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-18, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:29:30.271 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-18, inFlight=0, closed=true] closing connection 2021-08-11 16:29:30.271 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:29:30.272 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 32000 milliseconds 2021-08-11 16:29:30.272 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 32000 ms 2021-08-11 16:29:30.766 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:29:30.767 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:29:31.679 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:29:31.681 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-18, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:29:31.681 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-18, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:29:31.681 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-18, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:29:31.681 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-18, inFlight=0, closed=true] closing connection 2021-08-11 16:29:31.681 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:29:31.682 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 32000 milliseconds 2021-08-11 16:29:31.682 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 32000 ms 2021-08-11 16:29:33.854 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [766409965-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@38255a1e at consistency null 2021-08-11 16:29:33.855 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [766409965-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:33.883 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [740639773-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@561b4151 at consistency null 2021-08-11 16:29:33.883 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [740639773-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:33.911 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [639980208-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3783cdc1 at consistency null 2021-08-11 16:29:33.911 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [639980208-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:33.939 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1174879185-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5223430a at consistency null 2021-08-11 16:29:33.939 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1174879185-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:33.993 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [403734248-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@40c416fa at consistency null 2021-08-11 16:29:33.993 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [403734248-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:34.097 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [513000539-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4cd9c67a at consistency null 2021-08-11 16:29:34.097 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [513000539-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:34.200 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [305112555-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@659de7e5 at consistency null 2021-08-11 16:29:34.200 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [305112555-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:34.303 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1829359052-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2deed34f at consistency null 2021-08-11 16:29:34.303 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1829359052-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:34.506 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1995770299-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4dfd73ce at consistency null 2021-08-11 16:29:34.506 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1995770299-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:34.709 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1992604194-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f95961d at consistency null 2021-08-11 16:29:34.710 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1992604194-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:35.114 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [430655980-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@453df2c5 at consistency null 2021-08-11 16:29:35.114 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [430655980-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:35.518 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [980385976-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1e922586 at consistency null 2021-08-11 16:29:35.518 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [980385976-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:35.921 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1686765215-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@38d75699 at consistency null 2021-08-11 16:29:35.922 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1686765215-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:36.325 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [936336774-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5b111ae0 at consistency null 2021-08-11 16:29:36.325 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [936336774-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:36.728 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1953007290-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7110609d at consistency null 2021-08-11 16:29:36.728 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1953007290-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:37.532 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [851751631-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7ea1d52c at consistency null 2021-08-11 16:29:37.533 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [851751631-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:37.534 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-08-11T16:28:55.547Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.154.72:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-08-11 16:29:42.539 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [420663054-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7cc037ff at consistency null 2021-08-11 16:29:42.539 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [420663054-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:42.592 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1425838791-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2fd5f49d at consistency null 2021-08-11 16:29:42.592 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1425838791-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:42.695 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1678873524-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5db36d72 at consistency null 2021-08-11 16:29:42.695 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1678873524-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:42.898 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1934890803-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2d4bdb5d at consistency null 2021-08-11 16:29:42.899 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1934890803-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:43.301 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2083642600-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@50c97ec4 at consistency null 2021-08-11 16:29:43.302 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2083642600-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:43.704 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1290470147-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5038195c at consistency null 2021-08-11 16:29:43.704 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1290470147-0] Error querying cassandra/10.242.154.72:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-08-11 16:29:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:29:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:29:56.973 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.184.131:9042, scheduling delivery 2021-08-11 16:29:56.973 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] received event UP 2021-08-11 16:29:57.974 DEBUG 1 --- [luster-worker-8] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.184.131:9042 2021-08-11 16:29:57.978 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] marking host UP 2021-08-11 16:29:57.978 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP 2021-08-11 16:29:57.978 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.184.131:9042 2021-08-11 16:29:57.978 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:29:57.980 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-19, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 16:29:59.973 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.110.137:9042, scheduling delivery 2021-08-11 16:29:59.973 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] received event UP 2021-08-11 16:30:00.974 DEBUG 1 --- [luster-worker-9] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.110.137:9042 2021-08-11 16:30:00.977 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] marking host UP 2021-08-11 16:30:00.977 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP 2021-08-11 16:30:00.978 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.110.137:9042 2021-08-11 16:30:00.978 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:30:00.979 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-19, inFlight=0, closed=false] Connection established, initializing transport 2021-08-11 16:30:01.149 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-19, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 16:30:01.554 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 0 new connections, total = 1 2021-08-11 16:30:01.555 DEBUG 1 --- [luster-worker-8] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.184.131:9042 (1 connections needed, 1 successfully opened) 2021-08-11 16:30:01.555 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Session : Added connection pool for /10.242.184.131:9042 2021-08-11 16:30:04.165 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-19, inFlight=0, closed=false] Transport initialized, connection ready 2021-08-11 16:30:04.866 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 0 new connections, total = 1 2021-08-11 16:30:04.867 DEBUG 1 --- [luster-worker-9] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.110.137:9042 (1 connections needed, 1 successfully opened) 2021-08-11 16:30:04.867 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Session : Added connection pool for /10.242.110.137:9042 2021-08-11 16:30:30.978 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:30:30.980 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:30:39.578 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-19, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:30:39.581 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-19, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:30:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:30:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:31:00.980 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:31:00.982 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:31:04.672 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:31:04.673 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:31:19.691 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-19, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:31:19.745 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-19, inFlight=1, closed=false] heartbeat query succeeded 2021-08-11 16:31:30.983 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:31:30.985 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:31:39.710 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:31:39.713 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:31:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:31:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:32:00.985 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:32:00.987 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:32:30.987 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:32:30.989 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:32:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:32:49.318 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:33:00.990 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:33:00.991 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:33:04.907 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:33:04.909 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:33:29.962 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-19, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:33:29.965 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-19, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:33:30.992 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:33:30.994 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:33:44.977 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:33:44.980 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:33:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:33:49.316 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:34:00.994 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:34:00.996 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:34:15.025 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-19, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:34:15.030 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-19, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:34:30.997 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:34:30.999 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:34:49.314 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:34:49.317 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:35:00.999 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:35:01.001 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:35:20.147 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-19, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:35:20.150 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-19, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:35:31.002 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:35:31.004 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:35:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:35:49.319 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:36:01.005 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:36:01.006 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:36:20.263 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:36:20.266 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-2, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:36:31.006 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat 2021-08-11 16:36:31.008 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.154.72:9042-1, inFlight=0, closed=false] heartbeat query succeeded 2021-08-11 16:36:49.313 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering 2021-08-11 16:36:49.315 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting. 2021-08-11 16:36:59.361 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-19, inFlight=0, closed=false] connection error io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer at io.netty.channel.unix.FileDescriptor.readAddress(..)(Unknown Source) 2021-08-11 16:36:59.362 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-19, inFlight=0, closed=false] because: [/10.242.184.131:9042] Unexpected exception triggered (io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer) 2021-08-11 16:36:59.362 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preventing new connections for the next 1000 ms 2021-08-11 16:36:59.362 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-19, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:36:59.363 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-19, inFlight=0, closed=true] closing connection 2021-08-11 16:36:59.364 DEBUG 1 --- [uster-worker-10] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] marking host DOWN 2021-08-11 16:36:59.365 DEBUG 1 --- [uster-worker-10] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-08-11 16:36:59.365 DEBUG 1 --- [uster-worker-10] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] starting reconnection attempt 2021-08-11 16:36:59.453 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.184.131:9042, scheduling delivery 2021-08-11 16:36:59.454 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] received event DOWN 2021-08-11 16:37:00.366 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:37:00.369 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-20, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:37:00.369 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-20, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:37:00.370 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-20, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:37:00.370 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-20, inFlight=0, closed=true] closing connection 2021-08-11 16:37:00.371 DEBUG 1 --- [uster-worker-11] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:37:00.371 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-08-11 16:37:00.371 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 2000 ms 2021-08-11 16:37:00.455 DEBUG 1 --- [uster-worker-10] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:37:00.472 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-19, inFlight=0, closed=false] connection error io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer at io.netty.channel.unix.FileDescriptor.readAddress(..)(Unknown Source) 2021-08-11 16:37:00.473 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-19, inFlight=0, closed=false] because: [/10.242.110.137:9042] Unexpected exception triggered (io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer) 2021-08-11 16:37:00.473 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preventing new connections for the next 1000 ms 2021-08-11 16:37:00.473 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-19, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:37:00.473 DEBUG 1 --- [uster-worker-11] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] marking host DOWN 2021-08-11 16:37:00.473 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-19, inFlight=0, closed=true] closing connection 2021-08-11 16:37:00.474 DEBUG 1 --- [uster-worker-11] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-08-11 16:37:00.474 DEBUG 1 --- [uster-worker-11] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] starting reconnection attempt 2021-08-11 16:37:00.569 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.110.137:9042, scheduling delivery 2021-08-11 16:37:00.569 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] received event DOWN 2021-08-11 16:37:01.474 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:37:01.476 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-20, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:37:01.476 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-20, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect 2021-08-11 16:37:01.476 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] Connection[/10.242.110.137:9042-20, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:37:01.476 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-20, inFlight=0, closed=true] closing connection 2021-08-11 16:37:01.476 DEBUG 1 --- [uster-worker-10] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:37:01.477 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.110.137:9042 ([/10.242.110.137:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-08-11 16:37:01.477 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] next reconnection attempt in 2000 ms 2021-08-11 16:37:01.569 DEBUG 1 --- [uster-worker-11] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.110.137:9042 2021-08-11 16:37:02.372 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:37:02.374 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-21, inFlight=0, closed=false] Error connecting to /10.242.184.131:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.184.131:9042) 2021-08-11 16:37:02.375 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.184.131:9042-21, inFlight=0, closed=false] because: [/10.242.184.131:9042] Cannot connect 2021-08-11 16:37:02.375 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] Connection[/10.242.184.131:9042-21, inFlight=0, closed=false] failed, remaining = 0 2021-08-11 16:37:02.375 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.184.131:9042-21, inFlight=0, closed=true] closing connection 2021-08-11 16:37:02.375 DEBUG 1 --- [uster-worker-10] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.184.131:9042 2021-08-11 16:37:02.376 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.184.131:9042 ([/10.242.184.131:9042] Cannot connect), scheduling retry in 4000 milliseconds 2021-08-11 16:37:02.376 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.184.131:9042] next reconnection attempt in 4000 ms 2021-08-11 16:37:03.477 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.110.137:9042] preparing to open 1 new connections, total = 1 2021-08-11 16:37:03.479 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.110.137:9042-21, inFlight=0, closed=false] Error connecting to /10.242.110.137:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.110.137:9042) 2021-08-11 16:37:03.480 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.110.137:9042-21, inFlight=0, closed=false] because: [/10.242.110.137:9042] Cannot connect