By type
Project Build Version: 1.0.0
2021-04-29 14:59:08.669 INFO --- [ main] org.onap.aai.util.AAIConfig : Initializing AAIConfig
2021-04-29 14:59:08.765 DEBUG --- [ main] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-graphadmin/./resources/etc/appprops/aaiconfig.properties
2021-04-29 14:59:08.766 INFO --- [ main] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-graphadmin/./resources/etc/appprops/aaiconfig.properties
2021-04-29 14:59:08.769 INFO --- [ main] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename
2021-04-29 14:59:11.557 WARN 1 --- [ main] o.s.b.l.logback.LogbackLoggingSystem : Ignoring 'logback.configurationFile' system property. Please use 'logging.config' instead.
. ____ _ __ _ _
/\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
\\/ ___)| |_)| | | | | || (_| | ) ) ) )
' |____| .__|_| |_|_| |_\__, | / / / /
=========|_|==============|___/=/_/_/_/
:: Spring Boot :: (v2.1.12.RELEASE)
2021-04-29 14:59:12.426 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : Starting GraphAdminApp on aai-graphadmin with PID 1 (/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar started by aaiadmin in /opt/app/aai-graphadmin)
2021-04-29 14:59:12.427 DEBUG 1 --- [ main] org.onap.aai.GraphAdminApp : Running with Spring Boot v2.1.12.RELEASE, Spring v5.1.13.RELEASE
2021-04-29 14:59:12.428 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : The following profiles are active: dmaap,one-way-ssl
14:59:17,264 |-INFO in LogbackRequestLog - Will use configuration resource [/localhost-access-logback.xml]
14:59:17,275 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - debug attribute not set
14:59:17,275 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:59:17,276 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS]
14:59:17,276 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1421866327 - No compression will be used
14:59:17,276 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1421866327 - Will use the pattern /opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd} for the active file
14:59:17,276 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - The date pattern is 'yyyy-MM-dd' from file name pattern '/opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd}'.
14:59:17,276 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Roll-over at midnight.
14:59:17,277 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Setting initial period to Thu Apr 29 14:59:17 GMT 2021
14:59:17,297 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - Active log file name: /opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log
14:59:17,297 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - File property is set to [/opt/app/aai-graphadmin/logs/ajsc-jetty/localhost_access.log]
14:59:17,298 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS] to null
14:59:17,298 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - End of configuration.
14:59:17,298 |-INFO in ch.qos.logback.access.joran.JoranConfigurator@593aaf41 - Registering current configuration as safe fallback point
2021-04-29 14:59:17.551 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls:
jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/lib/aai-els-onap-logging-1.8.1.jar!/
2021-04-29 14:59:17.637 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 84 ms to scan 1 urls, producing 6 keys and 6 values
2021-04-29 14:59:17.641 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls:
jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/classes!/
2021-04-29 14:59:17.657 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 15 ms to scan 1 urls, producing 7 keys and 53 values
2021-04-29 14:59:17.693 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls:
jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/lib/aai-els-onap-logging-1.8.1.jar!/
2021-04-29 14:59:17.701 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 8 ms to scan 1 urls, producing 6 keys and 6 values
2021-04-29 14:59:17.706 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls:
jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/classes!/
2021-04-29 14:59:17.731 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 24 ms to scan 1 urls, producing 7 keys and 53 values
2021-04-29 14:59:17.738 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls:
jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/lib/aai-els-onap-logging-1.8.1.jar!/
2021-04-29 14:59:17.743 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 3 ms to scan 1 urls, producing 6 keys and 6 values
2021-04-29 14:59:17.747 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls:
jar:file:/opt/app/aai-graphadmin/lib/aai-graphadmin-1.8.0.jar!/BOOT-INF/classes!/
2021-04-29 14:59:17.762 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 15 ms to scan 1 urls, producing 7 keys and 53 values
2021-04-29 14:59:18.249 INFO 1 --- [ main] org.onap.aai.config.NodesConfiguration : Translator is SchemaServiceTranslator
2021-04-29 14:59:19.372 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:19.372 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:19.372 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:19.374 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:19.386 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/versions, BODY=
2021-04-29 14:59:19.839 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:19.839 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:19.839 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:19.840 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:20.470 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:20.593 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Processing the translator
2021-04-29 14:59:20.594 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv11
2021-04-29 14:59:20.594 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:20.697 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:20.697 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:20.697 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:20.698 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:20.756 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:20.802 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:20.803 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:20.803 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:24.632 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 222
2021-04-29 14:59:24.660 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv12
2021-04-29 14:59:24.661 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:24.663 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:24.663 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:24.663 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:24.663 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:24.681 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:24.727 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:24.728 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:24.728 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:26.064 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 235
2021-04-29 14:59:26.089 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv13
2021-04-29 14:59:26.089 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:26.091 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:26.091 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:26.091 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:26.092 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:26.124 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:26.159 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:26.160 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:26.160 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:27.286 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 237
2021-04-29 14:59:27.339 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv14
2021-04-29 14:59:27.340 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:27.341 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:27.341 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:27.342 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:27.342 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:27.357 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:27.374 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:27.374 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:27.374 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:28.933 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 272
2021-04-29 14:59:28.945 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv15
2021-04-29 14:59:28.945 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:28.947 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:28.947 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:28.947 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:28.947 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:28.961 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:28.976 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:28.977 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:28.977 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:30.464 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 279
2021-04-29 14:59:30.475 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv16
2021-04-29 14:59:30.475 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:30.477 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:30.477 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:30.477 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:30.477 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:30.512 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:30.529 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:30.529 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:30.529 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:32.245 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2021-04-29 14:59:32.257 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv17
2021-04-29 14:59:32.258 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:32.260 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:32.260 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:32.260 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:32.260 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:32.276 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:32.329 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:32.329 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:32.329 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:33.781 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2021-04-29 14:59:33.792 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv18
2021-04-29 14:59:33.792 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:33.794 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:33.794 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:33.794 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:33.794 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:33.808 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:33.833 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:33.834 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:33.834 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:35.294 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2021-04-29 14:59:35.323 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv19
2021-04-29 14:59:35.324 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:35.327 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:35.327 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:35.327 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:35.327 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:35.343 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:35.370 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:35.371 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:35.372 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:36.921 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 301
2021-04-29 14:59:36.932 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv20
2021-04-29 14:59:36.932 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:36.934 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:36.934 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:36.934 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:36.934 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:36.971 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:37.020 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:37.021 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:37.021 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:38.461 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 305
2021-04-29 14:59:38.472 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv21
2021-04-29 14:59:38.472 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:38.474 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:38.474 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:38.474 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:38.474 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:38.490 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:38.509 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:38.510 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:38.510 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:40.032 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 371
2021-04-29 14:59:40.045 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv22
2021-04-29 14:59:40.045 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:40.047 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:40.047 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:40.047 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:40.048 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:40.066 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:40.091 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:40.092 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:40.092 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:41.732 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378
2021-04-29 14:59:41.746 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv23
2021-04-29 14:59:41.747 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:41.751 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:41.751 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:41.751 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:41.751 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:41.769 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:41.795 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:41.795 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:41.795 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:43.559 DEBUG 1 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378
2021-04-29 14:59:43.666 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:43.667 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:43.667 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:43.671 INFO 1 --- [ main] o.onap.aai.rest.client.ApertureService : Successfully initialized the aperture service
2021-04-29 14:59:43.907 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Processing the translator
2021-04-29 14:59:43.908 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv11
2021-04-29 14:59:43.908 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:43.909 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v11, BODY=
2021-04-29 14:59:43.910 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:43.910 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:43.910 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:43.910 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:43.921 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:43.922 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:43.923 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:43.923 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv12
2021-04-29 14:59:43.923 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:43.924 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v12, BODY=
2021-04-29 14:59:43.925 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:43.925 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:43.925 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:43.925 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:43.932 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:43.935 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:43.935 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:43.935 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv13
2021-04-29 14:59:43.935 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:43.936 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v13, BODY=
2021-04-29 14:59:43.937 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:43.937 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:43.937 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:43.937 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:43.947 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:43.949 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:43.949 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:43.949 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv14
2021-04-29 14:59:43.949 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:43.950 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v14, BODY=
2021-04-29 14:59:43.951 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:43.951 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:43.951 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:43.951 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:43.960 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:43.962 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:43.963 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:43.963 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv15
2021-04-29 14:59:43.963 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:43.964 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v15, BODY=
2021-04-29 14:59:43.965 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:43.965 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:43.965 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:43.965 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:43.973 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:43.976 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:43.976 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:43.976 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv16
2021-04-29 14:59:43.976 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:43.977 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v16, BODY=
2021-04-29 14:59:43.978 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:43.978 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:43.978 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:43.978 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:43.989 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:43.991 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:43.992 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:43.992 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv17
2021-04-29 14:59:43.992 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:43.992 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v17, BODY=
2021-04-29 14:59:43.993 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:43.994 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:43.994 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:43.994 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:44.001 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:44.008 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:44.008 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:44.008 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv18
2021-04-29 14:59:44.009 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:44.009 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v18, BODY=
2021-04-29 14:59:44.010 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:44.010 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:44.010 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:44.010 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:44.019 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:44.022 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:44.022 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:44.022 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv19
2021-04-29 14:59:44.023 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:44.023 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v19, BODY=
2021-04-29 14:59:44.024 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:44.024 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:44.024 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:44.024 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:44.036 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:44.038 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:44.038 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:44.039 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv20
2021-04-29 14:59:44.039 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:44.039 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v20, BODY=
2021-04-29 14:59:44.046 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:44.046 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:44.046 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:44.046 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:44.060 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:44.062 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:44.063 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:44.063 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv21
2021-04-29 14:59:44.063 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:44.064 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v21, BODY=
2021-04-29 14:59:44.065 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:44.065 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:44.065 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:44.065 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:44.078 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:44.082 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:44.082 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:44.082 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv22
2021-04-29 14:59:44.083 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:44.083 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v22, BODY=
2021-04-29 14:59:44.084 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:44.084 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:44.084 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:44.084 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:44.095 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:44.100 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:44.100 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:44.101 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv23
2021-04-29 14:59:44.101 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:44.101 DEBUG 1 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v23, BODY=
2021-04-29 14:59:44.102 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:44.102 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:44.102 INFO 1 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:44.102 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:44.112 INFO 1 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:44.116 DEBUG 1 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:44.116 DEBUG 1 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 14:59:44.555 WARN 1 --- [ main] o.apache.activemq.broker.BrokerService : Memory Usage for the Broker (1024mb) is more than the maximum available for the JVM: 972 mb - resetting to 70% of maximum available: 680 mb
2021-04-29 14:59:46.371 INFO 1 --- [ main] com.datastax.driver.core : DataStax Java driver 3.6.0 for Apache Cassandra
2021-04-29 14:59:46.383 INFO 1 --- [ main] c.d.driver.core.GuavaCompatibility : Detected Guava >= 19 in the classpath, using modern compatibility layer
2021-04-29 14:59:46.384 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NEW_NODE_DELAY_SECONDS is undefined, using default value 1
2021-04-29 14:59:46.384 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NOTIF_LOCK_TIMEOUT_SECONDS is undefined, using default value 60
2021-04-29 14:59:46.442 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2021-04-29 14:59:46.919 INFO 1 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2021-04-29 14:59:46.923 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NON_BLOCKING_EXECUTOR_SIZE is undefined, using default value 2
2021-04-29 14:59:47.004 WARN 1 --- [ main] .b.a.g.t.GroovyTemplateAutoConfiguration : Cannot find template location: classpath:/templates/ (please add some templates, check your Groovy configuration, or set spring.groovy.template.check-template-location=false)
2021-04-29 14:59:48.023 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 14:59:48.033 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 14:59:49.659 WARN 1 --- [ main] org.glassfish.jersey.internal.Errors : The following warnings have been detected: WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.onap.aai.rest.AuditSqlDbConsumer.executeAudit(java.lang.String,java.lang.String,javax.ws.rs.core.HttpHeaders,javax.ws.rs.core.UriInfo), should not consume any entity.
2021-04-29 14:59:49.974 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : Started GraphAdminApp in 40.248 seconds (JVM running for 46.282)
2021-04-29 14:59:49.977 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : Application 'aai-graphadmin' is running on 8449!
2021-04-29 14:59:50.292 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2021-04-29 14:59:50.292 INFO 1 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2021-04-29 14:59:50.292 DEBUG 1 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.242.64.133:9042]
2021-04-29 14:59:50.326 DEBUG 1 --- [ main] i.n.u.i.logging.InternalLoggerFactory : Using SLF4J as the default logging framework
2021-04-29 14:59:50.408 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : -Dio.netty.noUnsafe: false
2021-04-29 14:59:50.409 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : Java version: 8
2021-04-29 14:59:50.411 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.theUnsafe: available
2021-04-29 14:59:50.412 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.copyMemory: available
2021-04-29 14:59:50.413 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Buffer.address: available
2021-04-29 14:59:50.414 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : direct buffer constructor: available
2021-04-29 14:59:50.423 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Bits.unaligned: available, true
2021-04-29 14:59:50.423 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9
2021-04-29 14:59:50.423 DEBUG 1 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.DirectByteBuffer.(long, int): available
2021-04-29 14:59:50.423 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : sun.misc.Unsafe: available
2021-04-29 14:59:50.424 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
2021-04-29 14:59:50.424 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.bitMode: 64 (sun.arch.data.model)
2021-04-29 14:59:50.426 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.noPreferDirect: false
2021-04-29 14:59:50.426 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.maxDirectMemory: 1020067840 bytes
2021-04-29 14:59:50.426 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.uninitializedArrayAllocationThreshold: -1
2021-04-29 14:59:50.427 DEBUG 1 --- [ main] io.netty.util.internal.CleanerJava6 : java.nio.ByteBuffer.cleaner(): available
2021-04-29 14:59:50.439 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FORCE_NIO is undefined, using default value false
2021-04-29 14:59:50.445 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.workdir: /tmp (io.netty.tmpdir)
2021-04-29 14:59:50.451 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library 'netty_transport_native_epoll_x86_64', trying other loading mechanism.
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:263)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:255)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:233)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:124)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.GraphAdminApp.main(GraphAdminApp.java:135)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:50)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:595)
2021-04-29 14:59:50.452 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : netty_transport_native_epoll_x86_64 cannot be loaded from java.libary.path, now trying export to -Dio.netty.native.workdir: /tmp
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:243)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:124)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.GraphAdminApp.main(GraphAdminApp.java:135)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:50)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:595)
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:263)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:255)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:233)
... 41 common frames omitted
2021-04-29 14:59:50.474 DEBUG 1 --- [ main] i.n.util.internal.NativeLibraryLoader : Successfully loaded the library /tmp/libnetty_transport_native_epoll_x86_646337744145829822008.so
2021-04-29 14:59:50.479 DEBUG 1 --- [ main] io.netty.util.NetUtil : Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo)
2021-04-29 14:59:50.480 DEBUG 1 --- [ main] io.netty.util.NetUtil : /proc/sys/net/core/somaxconn: 128
2021-04-29 14:59:50.481 INFO 1 --- [ main] com.datastax.driver.core.NettyUtil : Found Netty's native epoll transport in the classpath, using it
2021-04-29 14:59:50.519 DEBUG 1 --- [ main] i.n.channel.MultithreadEventLoopGroup : -Dio.netty.eventLoopThreads: 4
2021-04-29 14:59:50.563 DEBUG 1 --- [ main] i.netty.util.internal.PlatformDependent : org.jctools-core.MpscChunkedArrayQueue: available
2021-04-29 14:59:50.581 DEBUG 1 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.level: simple
2021-04-29 14:59:50.582 DEBUG 1 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.targetRecords: 4
2021-04-29 14:59:50.582 DEBUG 1 --- [ main] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@7d583602
2021-04-29 14:59:50.593 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.EXTENDED_PEER_CHECK is undefined, using default value true
2021-04-29 14:59:50.653 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:50.658 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.DISABLE_COALESCING is undefined, using default value false
2021-04-29 14:59:50.659 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_SCHEDULE_PERIOD_NS is undefined, using default value 10000
2021-04-29 14:59:50.659 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_RUN_WITHOUT_WORK_TIMES is undefined, using default value 5
2021-04-29 14:59:50.670 DEBUG 1 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024
2021-04-29 14:59:50.670 DEBUG 1 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096
2021-04-29 14:59:50.716 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numHeapArenas: 4
2021-04-29 14:59:50.716 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numDirectArenas: 4
2021-04-29 14:59:50.716 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.pageSize: 8192
2021-04-29 14:59:50.716 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxOrder: 11
2021-04-29 14:59:50.716 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.chunkSize: 16777216
2021-04-29 14:59:50.716 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.tinyCacheSize: 512
2021-04-29 14:59:50.716 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.smallCacheSize: 256
2021-04-29 14:59:50.716 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.normalCacheSize: 64
2021-04-29 14:59:50.716 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxCachedBufferCapacity: 32768
2021-04-29 14:59:50.716 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.cacheTrimInterval: 8192
2021-04-29 14:59:50.716 DEBUG 1 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.useCacheForAllThreads: true
2021-04-29 14:59:50.794 DEBUG 1 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.allocator.type: unpooled
2021-04-29 14:59:50.794 DEBUG 1 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.threadLocalDirectBufferSize: 65536
2021-04-29 14:59:50.794 DEBUG 1 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.maxThreadLocalCharBufferSize: 16384
2021-04-29 14:59:50.859 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:50.900 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxCapacity.default: 32768
2021-04-29 14:59:50.901 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxSharedCapacityFactor: 2
2021-04-29 14:59:50.901 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.linkCapacity: 16
2021-04-29 14:59:50.901 DEBUG 1 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.ratio: 8
2021-04-29 14:59:50.913 DEBUG 1 --- [er-nio-worker-0] io.netty.buffer.AbstractByteBuf : -Dio.netty.buffer.bytebuf.checkAccessible: true
2021-04-29 14:59:50.913 DEBUG 1 --- [er-nio-worker-0] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@3e61cfcc
2021-04-29 14:59:50.993 DEBUG 1 --- [er-nio-worker-0] c.datastax.driver.core.SystemProperties : com.datastax.driver.NATIVE_TRANSPORT_MAX_FRAME_SIZE_IN_MB is undefined, using default value 256
2021-04-29 14:59:51.797 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:51.800 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2021-04-29 14:59:52.000 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema
2021-04-29 14:59:52.227 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 14:59:52.239 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 12 milliseconds
2021-04-29 14:59:52.252 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.242.64.133:9042
2021-04-29 14:59:52.252 INFO 1 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor)
2021-04-29 14:59:52.254 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.242.64.133:9042 added
2021-04-29 14:59:52.255 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.226.88:9042 added
2021-04-29 14:59:52.255 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.76.214:9042 added
2021-04-29 14:59:52.260 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.CHECK_IO_DEADLOCKS is undefined, using default value true
2021-04-29 14:59:52.266 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 2
2021-04-29 14:59:52.269 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:52.278 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:52.278 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:52.279 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:52.279 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:52.664 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:52.667 DEBUG 1 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.226.88:9042 (1 connections needed, 1 successfully opened)
2021-04-29 14:59:52.668 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Session : Added connection pool for /10.242.226.88:9042
2021-04-29 14:59:52.891 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:52.891 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.242.64.133:9042 (1 connections needed, 1 successfully opened)
2021-04-29 14:59:52.891 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for cassandra/10.242.64.133:9042
2021-04-29 14:59:52.936 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:52.936 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.76.214:9042 (1 connections needed, 1 successfully opened)
2021-04-29 14:59:52.936 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.242.76.214:9042
2021-04-29 14:59:53.310 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TYPE dox.version, scheduling delivery
2021-04-29 14:59:53.479 DEBUG 1 --- [ main] org.reflections.Reflections : going to scan these urls:
file:/opt/app/aai-graphadmin/resources/
2021-04-29 14:59:53.482 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/addmanualdata/README in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.483 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/addmanualdata/README in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.483 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.483 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.483 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.483 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.483 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.483 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.484 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/dynamic.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.484 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/dynamic.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.484 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/datatoolscrons.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.484 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/datatoolscrons.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.484 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.484 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.484 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-migration.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.484 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-migration.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.484 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.485 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.485 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.485 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.485 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.485 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.485 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.485 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.486 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.486 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.486 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.486 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.486 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.486 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.487 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.487 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.487 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.487 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.488 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.488 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.488 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.488 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.488 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.489 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.489 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.489 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.489 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.490 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.490 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.490 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.491 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.491 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.491 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.491 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.491 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.492 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.492 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.492 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.492 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.492 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.492 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.493 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.493 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.493 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.493 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.493 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.493 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.493 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.493 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.494 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.494 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.494 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.494 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.494 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.494 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.495 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.495 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.495 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.495 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.495 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.495 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.495 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.495 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.495 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.496 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.496 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.496 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.496 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.496 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.496 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.496 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.497 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.497 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.497 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.497 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.497 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.497 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.497 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.498 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.498 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.498 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.498 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.498 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.498 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.498 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.498 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.499 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.499 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.499 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.499 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.499 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.499 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.499 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.499 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.500 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.500 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.500 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.500 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.500 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.501 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.501 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.501 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.501 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.501 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.502 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.502 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.502 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.502 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.502 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.502 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.502 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.503 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.503 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.503 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.503 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.503 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.503 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.503 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.503 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.504 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.504 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.504 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.504 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.504 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.504 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.504 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.504 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.505 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.505 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.505 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.505 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.505 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.505 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.505 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.505 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.506 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.506 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.506 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.506 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.506 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.506 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.506 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.506 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.507 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.507 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.507 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.507 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.507 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.507 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.507 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.508 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.508 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.508 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.508 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.508 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.508 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.508 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.508 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.509 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.509 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.509 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.509 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.509 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.509 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.510 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.510 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.510 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.510 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.510 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.512 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.512 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.512 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.512 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.512 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.513 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.513 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.513 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.513 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.513 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dynamicPayloadGenerator-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.513 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dynamicPayloadGenerator-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.513 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file forceDelete-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.513 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file forceDelete-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.513 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file updatePropertyTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.514 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file updatePropertyTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.514 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.514 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.514 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.514 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.514 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.515 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.515 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file org/janusgraph/graphdb/configuration/janusgraph.internal.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.515 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file org/janusgraph/graphdb/configuration/janusgraph.internal.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.515 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schemaMod-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.516 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file schemaMod-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.516 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.516 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.516 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dupeTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.516 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file dupeTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.516 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file migration-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.516 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file migration-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.516 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file uniquePropertyCheck-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.516 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file uniquePropertyCheck-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.517 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:53.517 DEBUG 1 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner
2021-04-29 14:59:53.517 INFO 1 --- [ main] org.reflections.Reflections : Reflections took 38 ms to scan 1 urls, producing 0 keys and 0 values
2021-04-29 14:59:53.738 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=true] closing connection
2021-04-29 14:59:53.739 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=true] closed, remaining = 1
2021-04-29 14:59:53.747 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=true] closing connection
2021-04-29 14:59:53.747 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-1, inFlight=0, closed=true] closed, remaining = 0
2021-04-29 14:59:53.747 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=true] closing connection
2021-04-29 14:59:53.748 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] Connection[/10.242.76.214:9042-1, inFlight=0, closed=true] closed, remaining = 0
2021-04-29 14:59:53.756 DEBUG 1 --- [ main] com.datastax.driver.core.Cluster : Shutting down
2021-04-29 14:59:53.758 DEBUG 1 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=true] closing connection
2021-04-29 14:59:53.758 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=true] closed, remaining = 0
2021-04-29 14:59:55.979 DEBUG 1 --- [er-nio-worker-2] io.netty.buffer.PoolThreadCache : Freed 21 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-2
2021-04-29 14:59:55.980 DEBUG 1 --- [er-nio-worker-0] io.netty.buffer.PoolThreadCache : Freed 39 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-0
2021-04-29 14:59:56.010 DEBUG 1 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2021-04-29 14:59:56.010 INFO 1 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2021-04-29 14:59:56.010 DEBUG 1 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.242.64.133:9042]
2021-04-29 14:59:56.016 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:56.021 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:56.233 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:56.234 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2021-04-29 14:59:56.245 DEBUG 1 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema
2021-04-29 14:59:56.313 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 14:59:56.320 DEBUG 1 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 7 milliseconds
2021-04-29 14:59:56.335 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.242.64.133:9042
2021-04-29 14:59:56.335 INFO 1 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor)
2021-04-29 14:59:56.335 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.242.64.133:9042 added
2021-04-29 14:59:56.335 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.226.88:9042 added
2021-04-29 14:59:56.335 INFO 1 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.76.214:9042 added
2021-04-29 14:59:56.335 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 2
2021-04-29 14:59:56.339 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:56.339 DEBUG 1 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:56.340 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:56.342 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:56.343 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:56.537 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:56.537 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.242.64.133:9042 (1 connections needed, 1 successfully opened)
2021-04-29 14:59:56.537 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for cassandra/10.242.64.133:9042
2021-04-29 14:59:57.016 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:57.017 DEBUG 1 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.76.214:9042 (1 connections needed, 1 successfully opened)
2021-04-29 14:59:57.017 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.242.76.214:9042
2021-04-29 14:59:57.194 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED KEYSPACE zusammen_workflow, scheduling delivery
2021-04-29 14:59:57.337 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:57.338 DEBUG 1 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.226.88:9042 (1 connections needed, 1 successfully opened)
2021-04-29 14:59:57.338 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Session : Added connection pool for /10.242.226.88:9042
2021-04-29 14:59:58.260 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_workflow
2021-04-29 14:59:58.266 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 14:59:58.272 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds
2021-04-29 14:59:58.822 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.version_info, scheduling delivery
2021-04-29 14:59:59.822 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.version_info (TABLE)
2021-04-29 14:59:59.952 INFO 1 --- [ main] org.onap.aai.GraphAdminApp : GraphAdmin MicroService Started
2021-04-29 14:59:59.953 DEBUG 1 --- [ main] org.onap.aai.GraphAdminApp : GraphAdmin MicroService Started
GraphAdmin Microservice Started
2021-04-29 15:00:01.253 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.version_info_deleted, scheduling delivery
2021-04-29 15:00:01.697 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE workflow.unique_value, scheduling delivery
2021-04-29 15:00:02.698 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:02.744 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:02.750 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds
2021-04-29 15:00:02.919 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.unique_value, scheduling delivery
2021-04-29 15:00:03.919 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.unique_value (TABLE)
2021-04-29 15:00:04.020 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.package_details, scheduling delivery
2021-04-29 15:00:04.669 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.item, scheduling delivery
2021-04-29 15:00:05.340 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_enriched_service_template, scheduling delivery
2021-04-29 15:00:05.705 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.version, scheduling delivery
2021-04-29 15:00:06.706 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:06.734 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:06.740 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds
2021-04-29 15:00:06.906 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.version_elements, scheduling delivery
2021-04-29 15:00:07.493 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_enriched_service_artifact, scheduling delivery
2021-04-29 15:00:08.493 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:08.605 DEBUG 1 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:08.612 DEBUG 1 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 7 milliseconds
2021-04-29 15:00:09.789 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element_namespace, scheduling delivery
2021-04-29 15:00:10.790 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_workflow.element_namespace (TABLE)
2021-04-29 15:00:11.396 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.application_config, scheduling delivery
2021-04-29 15:00:12.398 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.application_config (TABLE)
2021-04-29 15:00:12.596 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element, scheduling delivery
2021-04-29 15:00:13.597 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_workflow.element (TABLE)
2021-04-29 15:00:14.004 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element_synchronization_state, scheduling delivery
2021-04-29 15:00:15.005 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_workflow.element_synchronization_state (TABLE)
2021-04-29 15:00:15.403 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:15.738 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element_stage, scheduling delivery
2021-04-29 15:00:16.738 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:16.764 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:16.772 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 7 milliseconds
2021-04-29 15:00:16.897 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.version_stage, scheduling delivery
2021-04-29 15:00:17.205 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:18.205 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:18.232 DEBUG 1 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:18.239 DEBUG 1 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 7 milliseconds
2021-04-29 15:00:21.866 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:22.867 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2021-04-29 15:00:23.546 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:24.547 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2021-04-29 15:00:24.671 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:25.675 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2021-04-29 15:00:26.097 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:27.100 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2021-04-29 15:00:27.900 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.ecompcomponent, scheduling delivery
2021-04-29 15:00:28.901 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.ecompcomponent (TABLE)
2021-04-29 15:00:31.198 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:32.200 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2021-04-29 15:00:32.605 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.action_artifact, scheduling delivery
2021-04-29 15:00:33.606 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action_artifact (TABLE)
2021-04-29 15:00:34.488 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.activity_log, scheduling delivery
2021-04-29 15:00:35.489 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.activity_log (TABLE)
2021-04-29 15:00:36.084 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.healing, scheduling delivery
2021-04-29 15:00:37.013 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.migration, scheduling delivery
2021-04-29 15:00:38.013 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox
2021-04-29 15:00:38.033 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:38.042 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 8 milliseconds
2021-04-29 15:00:38.955 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.item_permissions, scheduling delivery
2021-04-29 15:00:39.360 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.user_permission_items, scheduling delivery
2021-04-29 15:00:40.140 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:00:40.142 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:00:40.360 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox
2021-04-29 15:00:40.367 DEBUG 1 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:40.373 DEBUG 1 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds
2021-04-29 15:00:40.434 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.notification_subscribers, scheduling delivery
2021-04-29 15:00:41.311 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.last_notification, scheduling delivery
2021-04-29 15:00:42.311 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox
2021-04-29 15:00:42.318 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:42.324 DEBUG 1 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds
2021-04-29 15:00:42.947 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.notifications, scheduling delivery
2021-04-29 15:00:43.832 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_merge_hint, scheduling delivery
2021-04-29 15:00:44.532 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.item, scheduling delivery
2021-04-29 15:00:45.190 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:00:45.192 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:00:45.398 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version, scheduling delivery
2021-04-29 15:00:46.308 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version_elements, scheduling delivery
2021-04-29 15:00:47.309 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:47.613 DEBUG 1 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:47.617 DEBUG 1 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 4 milliseconds
2021-04-29 15:00:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:00:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:00:48.289 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_namespace, scheduling delivery
2021-04-29 15:00:49.290 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.element_namespace (TABLE)
2021-04-29 15:00:50.797 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element, scheduling delivery
2021-04-29 15:00:51.798 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.element (TABLE)
2021-04-29 15:00:52.996 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_synchronization_state, scheduling delivery
2021-04-29 15:00:53.997 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.element_synchronization_state (TABLE)
2021-04-29 15:00:54.204 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_stage, scheduling delivery
2021-04-29 15:00:55.205 DEBUG 1 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.element_stage (TABLE)
2021-04-29 15:00:55.726 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version_stage, scheduling delivery
2021-04-29 15:00:56.726 DEBUG 1 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.version_stage (TABLE)
2021-04-29 15:01:20.388 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:01:20.395 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:01:26.730 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:01:26.788 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:01:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:01:48.030 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:01:55.625 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:01:55.632 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:01:56.788 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:01:56.789 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:02:10.826 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:02:10.936 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:02:26.790 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:02:26.793 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:02:35.944 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:02:35.947 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:02:48.025 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:02:48.028 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:02:56.793 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:02:56.795 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:03:21.238 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:03:21.240 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:03:26.795 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:03:26.798 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:03:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:03:48.028 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:03:56.798 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:03:56.803 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:04:26.803 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:04:26.805 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:04:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:04:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:04:56.805 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:04:56.807 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:05:11.745 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:05:11.747 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:05:26.808 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:05:26.810 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:05:26.915 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:05:26.917 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:05:48.025 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:05:48.028 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:05:56.810 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:05:56.815 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:05:57.033 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:05:57.034 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:06:26.815 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:06:26.817 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:06:37.148 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:06:37.214 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:06:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:06:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:06:56.818 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:06:56.820 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:07:02.390 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:07:02.392 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:07:22.442 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:07:22.444 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:07:26.820 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:07:26.822 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:07:48.023 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:07:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:07:56.823 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:07:56.830 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:08:17.725 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:08:17.727 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:08:26.830 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:08:27.004 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:08:47.915 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:08:47.932 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:08:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:08:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:08:57.004 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:08:57.012 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:09:27.013 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:09:27.017 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:09:41.616 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:09:41.619 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:09:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:09:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:09:57.017 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:09:57.189 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:10:06.940 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:10:06.942 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:10:27.190 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:10:27.206 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:10:48.023 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:10:48.025 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:10:57.206 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:10:57.507 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:11:11.011 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:11:11.909 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:11:27.507 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:11:28.092 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:11:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:11:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:11:56.177 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:11:56.214 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:11:58.092 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:11:58.541 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:12:01.228 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:12:01.296 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:12:28.541 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:12:29.012 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:12:31.296 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:12:33.600 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:12:41.315 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:12:41.317 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:12:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:12:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:12:59.012 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:12:59.017 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:13:11.318 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:13:11.320 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:13:29.017 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:13:29.024 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:13:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:13:48.030 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:13:59.025 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:14:04.373 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:14:04.375 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:14:06.254 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:14:06.532 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [880776509-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1232dc2b at consistency LOCAL_QUORUM
2021-04-29 15:14:06.532 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [880776509-0] Error querying cassandra/10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:14:06.996 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] Response received on stream 7936 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ROWS [4 columns]
---
2021-04-29 15:14:19.432 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:14:19.435 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:14:36.255 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:14:36.998 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:14:48.028 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:14:48.031 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:15:06.999 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:15:07.475 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:15:08.892 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:15:08.908 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:15:37.476 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:15:37.488 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:15:43.955 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:15:43.957 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:15:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:15:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:16:07.489 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:16:08.024 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:16:16.007 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:16:16.035 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:16:38.026 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:16:38.988 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:16:42.732 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:16:42.734 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:16:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:16:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:16:57.933 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:16:57.935 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:17:08.988 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:17:09.907 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:17:29.415 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:17:29.432 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:17:39.908 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:17:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:17:48.027 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:17:51.923 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] because: [cassandra/10.242.64.133:9042] Heartbeat query timed out
2021-04-29 15:17:51.977 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preventing new connections for the next 1000 ms
2021-04-29 15:17:51.977 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=false] failed, remaining = 1
2021-04-29 15:17:52.111 DEBUG 1 --- [ter-timeouter-0] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 0ms
2021-04-29 15:17:52.112 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [Control connection] starting reconnection attempt
2021-04-29 15:17:52.112 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=true] closing connection
2021-04-29 15:17:52.112 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:17:52.112 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:17:52.116 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:17:52.934 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 15:17:52.935 DEBUG 1 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2021-04-29 15:17:52.942 DEBUG 1 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:17:52.948 DEBUG 1 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 5 milliseconds
2021-04-29 15:17:52.955 DEBUG 1 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema
2021-04-29 15:17:53.382 DEBUG 1 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:17:53.386 DEBUG 1 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 4 milliseconds
2021-04-29 15:17:53.393 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] established to /10.242.226.88:9042
2021-04-29 15:17:53.393 DEBUG 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2021-04-29 15:17:55.205 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:17:55.214 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:17:59.432 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:17:59.437 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:18:23.360 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:18:23.363 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:18:26.033 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-1, inFlight=0, closed=true] has already terminated
2021-04-29 15:18:26.814 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:18:26.816 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:18:28.423 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1674326414-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5dc83a26 at consistency LOCAL_QUORUM
2021-04-29 15:18:28.423 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1674326414-0] Error querying cassandra/10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:18:31.827 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:18:31.831 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:18:41.329 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:18:41.856 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:18:48.025 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:18:48.029 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:18:53.363 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:18:53.365 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:19:00.523 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1630005659-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@591f6630 at consistency LOCAL_QUORUM
2021-04-29 15:19:00.524 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1630005659-0] Error querying cassandra/10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:19:00.734 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.64.133:9042, scheduling delivery
2021-04-29 15:19:00.734 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] received event DOWN
2021-04-29 15:19:01.743 DEBUG 1 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on cassandra/10.242.64.133:9042 because it still has active connections
2021-04-29 15:19:03.097 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] Response received on stream 9344 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:19:03.098 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] Response received on stream 9216 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:19:13.455 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:19:13.457 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:19:30.743 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:19:30.745 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:19:32.622 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [318079522-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6cdfc0d6 at consistency LOCAL_QUORUM
2021-04-29 15:19:32.623 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [318079522-0] Error querying cassandra/10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:19:33.098 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:19:45.101 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=1, closed=false] heartbeat query succeeded
2021-04-29 15:19:45.544 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:19:45.546 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:19:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:19:48.027 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:19:49.320 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=1, closed=false] Response received on stream 9408 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:19:54.722 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2094763778-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@21e2c279 at consistency LOCAL_QUORUM
2021-04-29 15:19:54.723 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2094763778-0] Error querying cassandra/10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:20:00.745 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:20:00.748 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:20:11.506 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] Response received on stream 9536 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:20:26.823 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1738039937-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3de7c569 at consistency LOCAL_QUORUM
2021-04-29 15:20:26.824 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1738039937-0] Error querying cassandra/10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:20:30.749 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:20:30.752 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:20:41.507 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:20:43.653 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=1, closed=false] Response received on stream 9600 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:20:43.687 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=1, closed=false] heartbeat query succeeded
2021-04-29 15:20:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:20:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:20:49.707 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:20:36.337Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:21:00.529 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:20:36.337Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:21:00.753 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:21:00.773 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:21:01.836 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:21:01.838 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:21:06.842 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:21:07.431 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:21:15.711 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:20:36.337Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:21:28.918 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:20:36.337Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:21:30.773 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:21:30.779 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:21:31.838 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:21:31.839 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:21:37.432 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:21:37.443 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:21:39.497 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1454245679-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7ef5fc2e at consistency null
2021-04-29 15:21:39.498 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1454245679-0] Error querying cassandra/10.242.64.133:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:21:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:21:48.027 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:22:00.780 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:22:00.831 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:22:09.499 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:22:21.522 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] because: [cassandra/10.242.64.133:9042] Heartbeat query timed out
2021-04-29 15:22:21.523 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preventing new connections for the next 2000 ms
2021-04-29 15:22:21.523 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:22:21.528 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=true] closing connection
2021-04-29 15:22:21.528 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:22:21.528 DEBUG 1 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] marking host DOWN
2021-04-29 15:22:21.549 DEBUG 1 --- [luster-worker-2] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:22:21.550 DEBUG 1 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] starting reconnection attempt
2021-04-29 15:22:22.550 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:22:22.552 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-3, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:22:30.832 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:22:31.397 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:22:33.249 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.64.133:9042-3, inFlight=0, closed=false] because: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:22:33.250 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-3, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:22:33.251 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-3, inFlight=0, closed=true] closing connection
2021-04-29 15:22:33.251 DEBUG 1 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.64.133:9042
2021-04-29 15:22:33.252 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-3, inFlight=0, closed=true] has already terminated
2021-04-29 15:22:33.252 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:22:33.253 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to cassandra/10.242.64.133:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:22:33.254 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] next reconnection attempt in 2000 ms
2021-04-29 15:22:35.255 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:22:35.257 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-4, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:22:37.794 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.64.133:9042-4, inFlight=0, closed=false] because: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:22:37.794 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-4, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:22:37.794 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-4, inFlight=0, closed=true] closing connection
2021-04-29 15:22:37.794 DEBUG 1 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.64.133:9042
2021-04-29 15:22:37.795 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-4, inFlight=0, closed=true] has already terminated
2021-04-29 15:22:37.795 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:22:37.795 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to cassandra/10.242.64.133:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:22:37.796 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] next reconnection attempt in 4000 ms
2021-04-29 15:22:41.796 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:22:41.798 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-5, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:22:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:22:48.029 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:22:52.509 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.64.133:9042-5, inFlight=0, closed=false] because: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:22:52.509 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-5, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:22:52.510 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-5, inFlight=0, closed=true] closing connection
2021-04-29 15:22:52.510 DEBUG 1 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.64.133:9042
2021-04-29 15:22:52.510 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-5, inFlight=0, closed=true] has already terminated
2021-04-29 15:22:52.510 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:22:52.511 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to cassandra/10.242.64.133:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:22:52.513 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] next reconnection attempt in 8000 ms
2021-04-29 15:22:56.038 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-2, inFlight=0, closed=true] has already terminated
2021-04-29 15:23:00.513 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:23:00.515 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-6, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:23:01.398 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:23:01.724 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:23:11.407 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.64.133:9042-6, inFlight=0, closed=false] because: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:23:11.407 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-6, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:23:11.408 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-6, inFlight=0, closed=true] closing connection
2021-04-29 15:23:11.408 DEBUG 1 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.64.133:9042
2021-04-29 15:23:11.409 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-6, inFlight=0, closed=true] has already terminated
2021-04-29 15:23:11.409 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:23:11.410 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to cassandra/10.242.64.133:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:23:11.411 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] next reconnection attempt in 16000 ms
2021-04-29 15:23:27.411 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:23:27.413 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-7, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:23:31.725 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:23:31.742 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:23:39.424 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.64.133:9042-7, inFlight=0, closed=false] because: [cassandra/10.242.64.133:9042] Operation timed out
2021-04-29 15:23:39.424 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-7, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:23:39.425 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-7, inFlight=0, closed=true] closing connection
2021-04-29 15:23:39.425 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.242.64.133:9042-7, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:23:39.425 DEBUG 1 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.64.133:9042
2021-04-29 15:23:39.426 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.242.64.133:9042 ([cassandra/10.242.64.133:9042] Operation timed out), scheduling retry in 32000 milliseconds
2021-04-29 15:23:39.426 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] next reconnection attempt in 32000 ms
2021-04-29 15:23:48.023 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:23:48.025 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:24:01.742 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:24:01.954 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:24:11.039 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-7, inFlight=0, closed=true] has already terminated
2021-04-29 15:24:11.426 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:24:11.429 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-8, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:24:15.399 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.64.133:9042-8, inFlight=0, closed=false] because: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:24:15.399 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-8, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:24:15.400 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-8, inFlight=0, closed=true] closing connection
2021-04-29 15:24:15.400 DEBUG 1 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.64.133:9042
2021-04-29 15:24:15.401 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-8, inFlight=0, closed=true] has already terminated
2021-04-29 15:24:15.401 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:24:15.402 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to cassandra/10.242.64.133:9042, scheduling retry in 64000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:24:15.403 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] next reconnection attempt in 64000 ms
2021-04-29 15:24:31.955 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:24:31.970 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:24:38.276 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:24:39.471 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:24:48.023 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:24:48.025 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:25:01.971 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:25:02.042 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:25:19.403 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:25:19.408 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-9, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:25:23.000 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.64.133:9042-9, inFlight=0, closed=false] because: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:23.001 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-9, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:25:23.001 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-9, inFlight=0, closed=true] closing connection
2021-04-29 15:25:23.002 DEBUG 1 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.64.133:9042
2021-04-29 15:25:23.002 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-9, inFlight=0, closed=true] has already terminated
2021-04-29 15:25:23.002 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:23.003 ERROR 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to cassandra/10.242.64.133:9042, scheduling retry in 128000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:25:23.004 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] next reconnection attempt in 128000 ms
2021-04-29 15:25:32.043 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:25:34.139 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:25:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:25:48.029 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:26:04.139 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:26:16.222 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] because: [/10.242.226.88:9042] Heartbeat query timed out
2021-04-29 15:26:16.223 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preventing new connections for the next 1000 ms
2021-04-29 15:26:16.223 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] failed, remaining = 1
2021-04-29 15:26:16.223 DEBUG 1 --- [ter-timeouter-0] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 0ms
2021-04-29 15:26:16.223 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [Control connection] starting reconnection attempt
2021-04-29 15:26:16.224 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:26:16.225 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=true] closing connection
2021-04-29 15:26:16.225 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-2, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:26:16.226 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:16.229 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.76.214:9042-2, inFlight=0, closed=false] because: Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:16.229 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preventing new connections for the next 1000 ms
2021-04-29 15:26:16.229 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] Connection[/10.242.76.214:9042-2, inFlight=0, closed=false] failed, remaining = 1
2021-04-29 15:26:16.229 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-2, inFlight=0, closed=true] closing connection
2021-04-29 15:26:16.230 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-2, inFlight=0, closed=true] has already terminated
2021-04-29 15:26:16.230 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:16.230 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 1000 ms
2021-04-29 15:26:17.231 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:26:17.232 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-3, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:17.234 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.76.214:9042-3, inFlight=0, closed=false] because: Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:17.234 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preventing new connections for the next 1000 ms
2021-04-29 15:26:17.234 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] Connection[/10.242.76.214:9042-3, inFlight=0, closed=false] failed, remaining = 1
2021-04-29 15:26:17.235 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-3, inFlight=0, closed=true] closing connection
2021-04-29 15:26:17.235 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-3, inFlight=0, closed=true] has already terminated
2021-04-29 15:26:17.235 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:17.235 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 2000 ms
2021-04-29 15:26:19.236 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:26:19.237 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-3, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:25.034 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:26:29.823 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1181615625-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@767f7f71 at consistency LOCAL_QUORUM
2021-04-29 15:26:29.823 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1181615625-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:26:31.323 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-3, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:26:31.323 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preventing new connections for the next 1000 ms
2021-04-29 15:26:31.323 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-3, inFlight=0, closed=false] failed, remaining = 1
2021-04-29 15:26:31.324 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-3, inFlight=0, closed=true] closing connection
2021-04-29 15:26:31.324 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-3, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:26:31.325 DEBUG 1 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] error on /10.242.226.88:9042 connection, trying next host
com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1496)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1575)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:663)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:738)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:466)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:26:31.325 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:26:31.326 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-4, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:31.330 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.76.214:9042-4, inFlight=0, closed=false] because: Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:31.330 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preventing new connections for the next 1000 ms
2021-04-29 15:26:31.330 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] Connection[/10.242.76.214:9042-4, inFlight=0, closed=false] failed, remaining = 1
2021-04-29 15:26:31.330 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-4, inFlight=0, closed=true] closing connection
2021-04-29 15:26:31.331 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-4, inFlight=0, closed=true] has already terminated
2021-04-29 15:26:31.331 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:31.331 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 4000 ms
2021-04-29 15:26:35.332 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:26:35.333 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-5, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:35.336 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.76.214:9042-5, inFlight=0, closed=false] because: Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:35.336 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preventing new connections for the next 1000 ms
2021-04-29 15:26:35.336 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] Connection[/10.242.76.214:9042-5, inFlight=0, closed=false] failed, remaining = 1
2021-04-29 15:26:35.336 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-5, inFlight=0, closed=true] closing connection
2021-04-29 15:26:35.337 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-5, inFlight=0, closed=true] has already terminated
2021-04-29 15:26:35.337 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:35.337 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 8000 ms
2021-04-29 15:26:37.122 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] because: [/10.242.226.88:9042] Heartbeat query timed out
2021-04-29 15:26:37.123 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preventing new connections for the next 2000 ms
2021-04-29 15:26:37.123 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:26:37.124 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=true] closing connection
2021-04-29 15:26:37.124 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-1, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:26:37.124 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] marking host DOWN
2021-04-29 15:26:37.124 DEBUG 1 --- [luster-worker-8] c.d.driver.core.ControlConnection : [Control connection] /10.242.226.88:9042 is down/removed and it was the control host, triggering reconnect
2021-04-29 15:26:37.125 DEBUG 1 --- [luster-worker-8] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:26:37.125 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] starting reconnection attempt
2021-04-29 15:26:37.914 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1209322772-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5e413b21 at consistency null
2021-04-29 15:26:37.914 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1209322772-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:38.014 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [801879091-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@43e57978 at consistency null
2021-04-29 15:26:38.014 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [801879091-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:38.118 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1060804433-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@23761b91 at consistency null
2021-04-29 15:26:38.118 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1060804433-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:38.125 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:26:38.127 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:38.222 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [164790513-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2d708e42 at consistency null
2021-04-29 15:26:38.222 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [164790513-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:38.325 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1740669106-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7abf20fe at consistency null
2021-04-29 15:26:38.325 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1740669106-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:38.528 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [366533205-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@12f9b868 at consistency null
2021-04-29 15:26:38.528 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [366533205-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:38.931 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2125682592-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1408335 at consistency null
2021-04-29 15:26:38.931 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2125682592-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:39.734 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1669039503-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@28eb1fc1 at consistency null
2021-04-29 15:26:39.734 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1669039503-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:40.537 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [6118466-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2bd062f2 at consistency null
2021-04-29 15:26:40.537 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [6118466-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:41.042 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=true] has already terminated
2021-04-29 15:26:41.340 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1392784494-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7435a518 at consistency null
2021-04-29 15:26:41.340 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1392784494-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:41.342 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:26:43.337 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:26:43.339 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-6, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:43.341 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.76.214:9042-6, inFlight=0, closed=false] because: Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:43.341 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preventing new connections for the next 1000 ms
2021-04-29 15:26:43.341 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] Connection[/10.242.76.214:9042-6, inFlight=0, closed=false] failed, remaining = 1
2021-04-29 15:26:43.342 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-6, inFlight=0, closed=true] closing connection
2021-04-29 15:26:43.342 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-6, inFlight=0, closed=true] has already terminated
2021-04-29 15:26:43.342 ERROR 1 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:43.342 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 16000 ms
2021-04-29 15:26:46.347 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [938375161-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7169c980 at consistency null
2021-04-29 15:26:46.347 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [938375161-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:46.375 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [134667126-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@18cd57b at consistency null
2021-04-29 15:26:46.375 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [134667126-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:46.402 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1658009976-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@29e3e04a at consistency null
2021-04-29 15:26:46.402 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1658009976-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:46.432 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [277267976-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@70a78d0b at consistency null
2021-04-29 15:26:46.433 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [277267976-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:46.486 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1418930782-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f3d7f56 at consistency null
2021-04-29 15:26:46.486 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1418930782-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:46.591 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1794152145-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@287d5cc7 at consistency null
2021-04-29 15:26:46.591 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1794152145-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:46.794 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [294873614-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1e2a0832 at consistency null
2021-04-29 15:26:46.794 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [294873614-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:46.997 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [922962098-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@52290129 at consistency null
2021-04-29 15:26:46.998 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [922962098-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:47.401 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2047821270-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@764a03f5 at consistency null
2021-04-29 15:26:47.401 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2047821270-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:48.023 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:26:48.025 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:26:48.204 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [338104920-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3413e29f at consistency null
2021-04-29 15:26:48.204 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [338104920-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:49.814 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [518965704-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7ab617b7 at consistency null
2021-04-29 15:26:49.814 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [518965704-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:49.815 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:26:50.223 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-4, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:26:50.223 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-4, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:26:50.224 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=0, closed=true] closing connection
2021-04-29 15:26:50.224 DEBUG 1 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:26:50.224 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-4, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:26:50.225 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 2000 milliseconds
2021-04-29 15:26:50.225 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 2000 ms
2021-04-29 15:26:52.225 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:26:52.227 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-5, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:54.821 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [855987327-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@467f83ce at consistency null
2021-04-29 15:26:54.821 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [855987327-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:54.849 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [858035772-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6dd39684 at consistency null
2021-04-29 15:26:54.849 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [858035772-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:54.877 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [532539346-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27922f26 at consistency null
2021-04-29 15:26:54.877 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [532539346-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:54.929 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2004213092-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2491d23c at consistency null
2021-04-29 15:26:54.929 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2004213092-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:54.982 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1850394969-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1e4a4493 at consistency null
2021-04-29 15:26:54.982 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1850394969-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:55.035 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2034771930-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6f5c8668 at consistency null
2021-04-29 15:26:55.035 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2034771930-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:55.088 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [163302486-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@59816fba at consistency null
2021-04-29 15:26:55.088 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [163302486-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:55.190 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1350352632-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@732b4684 at consistency null
2021-04-29 15:26:55.190 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1350352632-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:55.413 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1749329327-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f89faae at consistency null
2021-04-29 15:26:55.414 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1749329327-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:55.617 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1351235978-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@34ed44f1 at consistency null
2021-04-29 15:26:55.617 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1351235978-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:55.820 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [117741233-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@66c31169 at consistency null
2021-04-29 15:26:55.820 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [117741233-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:56.042 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-3, inFlight=0, closed=true] has already terminated
2021-04-29 15:26:56.223 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [851076055-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4ff56453 at consistency null
2021-04-29 15:26:56.223 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [851076055-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:57.026 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2132726258-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f59bb89 at consistency null
2021-04-29 15:26:57.026 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2132726258-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:58.629 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2119819762-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@614daa5f at consistency null
2021-04-29 15:26:58.629 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2119819762-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:58.631 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:26:59.342 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:26:59.344 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-7, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:59.346 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.76.214:9042-7, inFlight=0, closed=false] because: Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:59.347 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preventing new connections for the next 1000 ms
2021-04-29 15:26:59.347 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] Connection[/10.242.76.214:9042-7, inFlight=0, closed=false] failed, remaining = 1
2021-04-29 15:26:59.347 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-7, inFlight=0, closed=true] closing connection
2021-04-29 15:26:59.347 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-7, inFlight=0, closed=true] has already terminated
2021-04-29 15:26:59.347 ERROR 1 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:59.347 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 32000 ms
2021-04-29 15:27:03.634 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1573605782-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1f7bb746 at consistency null
2021-04-29 15:27:03.635 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1573605782-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:03.688 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1015952675-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7b489f06 at consistency null
2021-04-29 15:27:03.688 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1015952675-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:03.791 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [890692097-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@9bff615 at consistency null
2021-04-29 15:27:03.791 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [890692097-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:03.893 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [74564384-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5acaa2f at consistency null
2021-04-29 15:27:03.893 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [74564384-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:03.996 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [61957593-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@47affc5b at consistency null
2021-04-29 15:27:03.996 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [61957593-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:04.099 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1323007905-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@78a0eb07 at consistency null
2021-04-29 15:27:04.099 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1323007905-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:04.302 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1281329809-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ed9a558 at consistency null
2021-04-29 15:27:04.302 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1281329809-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:04.322 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-5, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:27:04.322 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-5, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:27:04.323 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-5, inFlight=0, closed=true] closing connection
2021-04-29 15:27:04.323 DEBUG 1 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:27:04.323 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-5, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:27:04.323 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 4000 milliseconds
2021-04-29 15:27:04.323 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 4000 ms
2021-04-29 15:27:04.505 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1186801913-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6ec49b7e at consistency null
2021-04-29 15:27:04.505 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1186801913-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:04.908 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1311375962-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@56b1ffd9 at consistency null
2021-04-29 15:27:04.908 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1311375962-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:05.711 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1528384073-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@29b6dedb at consistency null
2021-04-29 15:27:05.711 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1528384073-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:07.314 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1805801657-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6a065dd0 at consistency null
2021-04-29 15:27:07.315 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1805801657-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:07.316 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:27:08.324 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:27:08.325 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-6, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:27:11.043 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=true] has already terminated
2021-04-29 15:27:12.320 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1148669908-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@20533485 at consistency null
2021-04-29 15:27:12.320 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1148669908-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:12.373 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1523690962-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@79c55861 at consistency null
2021-04-29 15:27:12.373 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1523690962-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:12.426 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1267466179-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@669a1184 at consistency null
2021-04-29 15:27:12.426 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1267466179-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:12.479 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [848630171-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3eaa285a at consistency null
2021-04-29 15:27:12.479 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [848630171-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:12.531 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1281548786-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@764d416 at consistency null
2021-04-29 15:27:12.531 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1281548786-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:12.634 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [462056081-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@543192cb at consistency null
2021-04-29 15:27:12.634 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [462056081-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:12.743 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [258735044-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6291aff8 at consistency null
2021-04-29 15:27:12.744 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [258735044-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:12.947 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [359152251-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@d96b308 at consistency null
2021-04-29 15:27:12.947 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [359152251-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:13.151 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1314796629-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2cf302c8 at consistency null
2021-04-29 15:27:13.151 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1314796629-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:13.354 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [113775085-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@740c6a57 at consistency null
2021-04-29 15:27:13.354 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [113775085-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:13.757 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1454206763-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1b0de541 at consistency null
2021-04-29 15:27:13.757 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1454206763-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:14.274 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-6, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 15:27:14.275 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Successful reconnection to /10.242.226.88:9042, setting host UP
2021-04-29 15:27:14.275 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] marking host UP
2021-04-29 15:27:14.275 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2021-04-29 15:27:14.275 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.226.88:9042
2021-04-29 15:27:14.560 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [46283879-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@233b0bdb at consistency null
2021-04-29 15:27:14.560 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [46283879-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:15.252 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 0 new connections, total = 1
2021-04-29 15:27:15.253 DEBUG 1 --- [-reconnection-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.226.88:9042 (1 connections needed, 1 successfully opened)
2021-04-29 15:27:15.255 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Session : Added connection pool for /10.242.226.88:9042
2021-04-29 15:27:15.297 DEBUG 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2021-04-29 15:27:16.214 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1023495414-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@176ab836 at consistency null
2021-04-29 15:27:16.214 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1023495414-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:21.247 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:27:26.043 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=0, closed=true] has already terminated
2021-04-29 15:27:26.252 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2072012226-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@23365e at consistency null
2021-04-29 15:27:26.252 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2072012226-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:31.004 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:27:31.006 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-10, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:27:31.348 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:27:31.349 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-8, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:27:31.352 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.76.214:9042-8, inFlight=0, closed=false] because: Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:27:31.353 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preventing new connections for the next 1000 ms
2021-04-29 15:27:31.353 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] Connection[/10.242.76.214:9042-8, inFlight=0, closed=false] failed, remaining = 1
2021-04-29 15:27:31.353 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-8, inFlight=0, closed=true] closing connection
2021-04-29 15:27:31.354 DEBUG 1 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-8, inFlight=0, closed=true] has already terminated
2021-04-29 15:27:31.354 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:27:31.354 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 64000 ms
2021-04-29 15:27:34.803 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.64.133:9042-10, inFlight=0, closed=false] because: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:27:34.803 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] Connection[cassandra/10.242.64.133:9042-10, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:27:34.804 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-10, inFlight=0, closed=true] closing connection
2021-04-29 15:27:34.804 DEBUG 1 --- [uster-worker-10] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.64.133:9042
2021-04-29 15:27:34.805 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.64.133:9042-10, inFlight=0, closed=true] has already terminated
2021-04-29 15:27:34.805 ERROR 1 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:27:34.805 ERROR 1 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to cassandra/10.242.64.133:9042, scheduling retry in 256000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra/10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:27:34.806 DEBUG 1 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.242.64.133:9042] next reconnection attempt in 256000 ms
2021-04-29 15:27:38.323 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2072012226-0] Doing retry 2 for query com.datastax.driver.core.BoundStatement@23365e at consistency LOCAL_QUORUM
2021-04-29 15:27:38.323 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2072012226-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:27:38.324 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.226.88:9042 (com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response), /10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.226.88:9042 (com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response), /10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:962)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1575)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:663)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:738)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:466)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:27:41.044 DEBUG 1 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-5, inFlight=0, closed=true] has already terminated
2021-04-29 15:27:43.050 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-6, inFlight=0, closed=false] Response received on stream 3712 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:27:48.023 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:27:48.025 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:27:49.831 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:27:56.252 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:27:56.254 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:28:03.731 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1440457728-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2afd253e at consistency null
2021-04-29 15:28:03.731 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1440457728-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:03.734 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:28:14.668 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1644831921-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@595483cb at consistency null
2021-04-29 15:28:14.669 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1644831921-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:14.673 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:28:22.974 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [450687815-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4ded0b20 at consistency null
2021-04-29 15:28:22.974 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [450687815-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:23.046 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [284306763-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5d8d300b at consistency null
2021-04-29 15:28:23.046 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [284306763-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:23.166 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [402747633-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1e9a3a51 at consistency null
2021-04-29 15:28:23.166 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [402747633-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:23.376 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [723382508-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4d07e6a3 at consistency null
2021-04-29 15:28:23.376 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [723382508-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:29.055 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:28:34.060 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1453750275-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@548fa89b at consistency null
2021-04-29 15:28:34.061 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1453750275-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:35.355 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:28:35.358 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-9, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:28:35.419 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.76.214:9042-9, inFlight=0, closed=false] because: Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:28:35.419 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] preventing new connections for the next 1000 ms
2021-04-29 15:28:35.420 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.76.214:9042] Connection[/10.242.76.214:9042-9, inFlight=0, closed=false] failed, remaining = 1
2021-04-29 15:28:35.420 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-9, inFlight=0, closed=true] closing connection
2021-04-29 15:28:35.420 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.76.214:9042-9, inFlight=0, closed=true] has already terminated
2021-04-29 15:28:35.420 ERROR 1 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.76.214:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:28:35.421 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 128000 ms
2021-04-29 15:28:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:28:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:28:49.730 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1472172009-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@46bc0bdc at consistency null
2021-04-29 15:28:49.731 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1472172009-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:49.734 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:28:54.739 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1143667479-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27ebe9b0 at consistency null
2021-04-29 15:28:54.739 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1143667479-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:55.986 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [7666158-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@72856668 at consistency null
2021-04-29 15:28:55.986 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [7666158-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:56.040 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1710747523-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3d8292db at consistency null
2021-04-29 15:28:56.040 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1710747523-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:56.114 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1318904851-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5a5be479 at consistency null
2021-04-29 15:28:56.114 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1318904851-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:00.410 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1568492692-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@336554d1 at consistency null
2021-04-29 15:29:00.410 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1568492692-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:00.413 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:29:05.418 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2061591900-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@289b236f at consistency null
2021-04-29 15:29:05.418 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [2061591900-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:05.473 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [548406900-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@15215b8a at consistency null
2021-04-29 15:29:05.474 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [548406900-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:05.527 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [153469453-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1f98d97 at consistency null
2021-04-29 15:29:05.527 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [153469453-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:09.062 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1040922193-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4cced960 at consistency null
2021-04-29 15:29:09.062 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1040922193-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:09.168 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1328643913-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@79a74271 at consistency null
2021-04-29 15:29:09.169 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1328643913-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:09.231 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:29:14.235 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1863467901-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7c5a0910 at consistency null
2021-04-29 15:29:14.235 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1863467901-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:23.592 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:29:28.596 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1208013112-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@dabddaf at consistency null
2021-04-29 15:29:28.597 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1208013112-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:34.973 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:29:46.150 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [803135447-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@65f39e68 at consistency null
2021-04-29 15:29:46.151 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [803135447-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:46.153 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:29:48.023 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:29:48.025 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:30:03.223 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1800480338-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@647f1d2b at consistency LOCAL_QUORUM
2021-04-29 15:30:03.224 DEBUG 1 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1800480338-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:30:03.227 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:30:05.054 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-6, inFlight=0, closed=false] Response received on stream 5184 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR UNAVAILABLE: Cannot achieve consistency level LOCAL_QUORUM
2021-04-29 15:30:08.250 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [379947502-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7c299ddb at consistency null
2021-04-29 15:30:08.250 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [379947502-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:08.307 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1482818323-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@634b74df at consistency null
2021-04-29 15:30:08.307 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1482818323-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:08.390 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [26959791-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@59f4a40f at consistency null
2021-04-29 15:30:08.390 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [26959791-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:08.494 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1662683768-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@40f37cb8 at consistency null
2021-04-29 15:30:08.494 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1662683768-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:08.634 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1498055948-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@208d6187 at consistency null
2021-04-29 15:30:08.634 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1498055948-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:08.738 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [301494189-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3841a1d at consistency null
2021-04-29 15:30:08.738 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [301494189-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:08.858 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1246051354-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@10faf708 at consistency null
2021-04-29 15:30:08.858 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1246051354-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:08.978 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2101032544-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@282f9444 at consistency null
2021-04-29 15:30:08.978 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [2101032544-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:09.182 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1884601902-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2f3a81f4 at consistency null
2021-04-29 15:30:09.182 DEBUG 1 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1884601902-0] Error querying /10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:09.638 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [579023502-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@54879992 at consistency null
2021-04-29 15:30:09.638 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [579023502-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:10.631 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1095073576-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1fcd4bdc at consistency null
2021-04-29 15:30:10.631 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1095073576-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:10.635 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:30:24.846 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1701431638-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5848ad9a at consistency null
2021-04-29 15:30:24.847 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1701431638-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:24.849 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:30:33.845 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [806993435-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@c919f63 at consistency null
2021-04-29 15:30:33.846 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [806993435-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:33.848 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921)
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725)
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400)
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300)
at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 23 common frames omitted
2021-04-29 15:30:43.421 DEBUG 1 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:30:43.424 DEBUG 1 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-7, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:30:48.024 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Entering
2021-04-29 15:30:48.026 INFO 1 --- [ scheduling-1] o.o.a.a.logs.AaiScheduledTaskAuditLog : Exiting.
2021-04-29 15:30:50.442 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [188083668-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@64b2dc6a at consistency null
2021-04-29 15:30:50.443 DEBUG 1 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [188083668-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:50.515 WARN 1 --- [pool-9-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:17.301Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)