By type
*** retrieve Truststore and Keystore password
*** actual launch of AAI Resources
2021-04-29 14:59:23.173 INFO --- [ main] org.onap.aai.util.AAIConfig : Initializing AAIConfig
2021-04-29 14:59:23.182 DEBUG --- [ main] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2021-04-29 14:59:23.182 INFO --- [ main] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2021-04-29 14:59:23.184 INFO --- [ main] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename
2021-04-29 14:59:24.914 WARN 10 --- [ main] o.s.b.l.logback.LogbackLoggingSystem : Ignoring 'logback.configurationFile' system property. Please use 'logging.config' instead.
2021-04-29 14:59:25.005 DEBUG 10 --- [kground-preinit] .h.v.m.ResourceBundleMessageInterpolator : Loaded expression factory via original TCCL
2021-04-29 14:59:25.024 DEBUG 10 --- [kground-preinit] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.messageinterpolation.ResourceBundleMessageInterpolator as ValidatorFactory-scoped message interpolator.
2021-04-29 14:59:25.024 DEBUG 10 --- [kground-preinit] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.resolver.JPATraversableResolver as ValidatorFactory-scoped traversable resolver.
2021-04-29 14:59:25.024 DEBUG 10 --- [kground-preinit] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.util.ExecutableParameterNameProvider as ValidatorFactory-scoped parameter name provider.
2021-04-29 14:59:25.024 DEBUG 10 --- [kground-preinit] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.DefaultClockProvider as ValidatorFactory-scoped clock provider.
2021-04-29 14:59:25.024 DEBUG 10 --- [kground-preinit] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.scripting.DefaultScriptEvaluatorFactory as ValidatorFactory-scoped script evaluator factory.
. ____ _ __ _ _
/\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
\\/ ___)| |_)| | | | | || (_| | ) ) ) )
' |____| .__|_| |_|_| |_\__, | / / / /
=========|_|==============|___/=/_/_/_/
:: Spring Boot :: (v2.1.12.RELEASE)
14:59:29,470 |-INFO in LogbackRequestLog - Will use configuration resource [/localhost-access-logback.xml]
14:59:29,477 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - debug attribute not set
14:59:29,477 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
14:59:29,477 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS]
14:59:29,479 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1537471098 - No compression will be used
14:59:29,479 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@1537471098 - Will use the pattern /opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd} for the active file
14:59:29,479 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - The date pattern is 'yyyy-MM-dd' from file name pattern '/opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd}'.
14:59:29,479 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Roll-over at midnight.
14:59:29,479 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Setting initial period to Thu Apr 29 14:59:29 GMT 2021
14:59:29,505 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - Active log file name: /opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log
14:59:29,505 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - File property is set to [/opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log]
14:59:29,505 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS] to null
14:59:29,505 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - End of configuration.
14:59:29,505 |-INFO in ch.qos.logback.access.joran.JoranConfigurator@58d75e99 - Registering current configuration as safe fallback point
2021-04-29 14:59:29.703 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED CLASSES [class org.onap.aai.rest.search.ModelAndNamedQueryRestProvider, class org.onap.aai.rest.util.EchoResponse, class org.onap.aai.rest.CQ2GremlinTest, class org.onap.aai.rest.search.SearchProvider, class org.onap.aai.rest.DslConsumer, class org.onap.aai.rest.CQ2Gremlin, class org.onap.aai.rest.RecentAPIConsumer, class org.onap.aai.rest.QueryConsumer]
2021-04-29 14:59:29.707 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestTransactionLogging result=true
2021-04-29 14:59:29.707 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestModification result=true
2021-04-29 14:59:29.708 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionLatestInterceptor result=true
2021-04-29 14:59:29.708 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionInterceptor result=true
2021-04-29 14:59:29.709 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HeaderValidation result=true
2021-04-29 14:59:29.709 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.OneWaySslAuthorization result=false
2021-04-29 14:59:29.710 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HttpHeaderInterceptor result=true
2021-04-29 14:59:29.711 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.InvalidResponseStatus result=true
2021-04-29 14:59:29.711 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseHeaderManipulation result=true
2021-04-29 14:59:29.712 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseTransactionLogging result=true
2021-04-29 14:59:29.712 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestHeaderManipulation result=true
2021-04-29 14:59:29.713 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RetiredInterceptor result=true
2021-04-29 14:59:29.716 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestTransactionLogging result=true
2021-04-29 14:59:29.717 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestModification result=true
2021-04-29 14:59:29.717 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionLatestInterceptor result=true
2021-04-29 14:59:29.718 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionInterceptor result=true
2021-04-29 14:59:29.718 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HeaderValidation result=true
2021-04-29 14:59:29.719 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.OneWaySslAuthorization result=false
2021-04-29 14:59:29.720 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HttpHeaderInterceptor result=true
2021-04-29 14:59:29.720 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.InvalidResponseStatus result=true
2021-04-29 14:59:29.721 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseHeaderManipulation result=true
2021-04-29 14:59:29.721 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseTransactionLogging result=true
2021-04-29 14:59:29.722 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestHeaderManipulation result=true
2021-04-29 14:59:29.722 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RetiredInterceptor result=true
2021-04-29 14:59:29.723 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RequestTransactionLogging
2021-04-29 14:59:29.724 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.post.InvalidResponseStatus
2021-04-29 14:59:29.724 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.HeaderValidation
2021-04-29 14:59:29.725 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.post.ResponseTransactionLogging
2021-04-29 14:59:29.726 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.HttpHeaderInterceptor
2021-04-29 14:59:29.726 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.post.ResponseHeaderManipulation
2021-04-29 14:59:29.727 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.VersionLatestInterceptor
2021-04-29 14:59:29.728 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RetiredInterceptor
2021-04-29 14:59:29.728 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.VersionInterceptor
2021-04-29 14:59:29.729 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RequestHeaderManipulation
2021-04-29 14:59:29.729 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RequestModification
2021-04-29 14:59:30.097 INFO 10 --- [ main] org.onap.aai.config.NodesConfiguration : Translator is SchemaServiceTranslator
2021-04-29 14:59:30.534 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:30.534 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:30.534 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:30.535 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 14:59:30.548 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/versions, BODY=
2021-04-29 14:59:30.662 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:30.662 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:30.662 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:30.663 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:31.064 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:31.158 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Processing the translator
2021-04-29 14:59:31.159 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv11
2021-04-29 14:59:31.160 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:31.232 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:31.232 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:31.232 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:31.232 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:31.250 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:31.296 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:31.297 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:31.297 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:34.136 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 222
2021-04-29 14:59:34.151 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv12
2021-04-29 14:59:34.151 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:34.153 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:34.153 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:34.153 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:34.153 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:34.203 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:34.249 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:34.250 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:34.250 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:35.748 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 235
2021-04-29 14:59:35.878 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv13
2021-04-29 14:59:35.903 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:35.909 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:35.909 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:35.909 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:35.909 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:35.925 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:35.952 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:35.953 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:35.953 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:37.229 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 237
2021-04-29 14:59:37.243 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv14
2021-04-29 14:59:37.244 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:37.246 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:37.246 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:37.246 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:37.246 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:37.260 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:37.276 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:37.277 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:37.277 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:38.505 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 272
2021-04-29 14:59:38.516 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv15
2021-04-29 14:59:38.516 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:38.518 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:38.518 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:38.518 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:38.518 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:38.533 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:38.549 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:38.549 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:38.549 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:39.940 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 279
2021-04-29 14:59:39.951 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv16
2021-04-29 14:59:39.951 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:39.953 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:39.953 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:39.953 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:39.953 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:39.983 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:39.998 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:39.998 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:39.998 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:41.304 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2021-04-29 14:59:41.315 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv17
2021-04-29 14:59:41.315 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:41.318 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:41.319 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:41.319 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:41.319 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:41.333 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:41.348 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:41.348 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:41.349 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:42.933 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2021-04-29 14:59:42.941 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv18
2021-04-29 14:59:42.942 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:42.944 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:42.944 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:42.944 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:42.944 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:42.978 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:42.995 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:42.997 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:42.997 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:44.326 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2021-04-29 14:59:44.335 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv19
2021-04-29 14:59:44.335 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:44.337 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:44.337 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:44.337 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:44.337 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:44.350 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:44.365 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:44.366 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:44.366 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:45.970 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 301
2021-04-29 14:59:45.979 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv20
2021-04-29 14:59:45.979 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:45.981 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:45.981 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:45.981 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:45.981 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:45.995 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:46.011 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:46.011 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:46.011 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:47.310 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 305
2021-04-29 14:59:47.318 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv21
2021-04-29 14:59:47.319 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:47.321 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:47.321 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:47.321 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:47.321 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:47.337 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:47.369 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:47.370 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:47.370 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:48.924 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 371
2021-04-29 14:59:48.934 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv22
2021-04-29 14:59:48.935 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:48.936 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:48.936 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:48.936 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:48.936 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:48.973 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:48.997 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:48.997 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:48.997 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:50.749 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378
2021-04-29 14:59:50.762 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv23
2021-04-29 14:59:50.763 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2021-04-29 14:59:50.765 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 14:59:50.765 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 14:59:50.765 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 14:59:50.765 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 14:59:50.794 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 14:59:50.827 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 14:59:50.827 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2021-04-29 14:59:50.828 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2021-04-29 14:59:52.631 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378
2021-04-29 14:59:52.647 DEBUG 10 --- [ main] org.onap.aai.TraversalApp : AAI Server initialization started...
2021-04-29 14:59:52.647 DEBUG 10 --- [ main] org.onap.aai.TraversalApp : Starting AAIGraph connections and the NodeInjestor
2021-04-29 14:59:52.648 INFO 10 --- [ main] org.onap.aai.util.AAIConfig : Initializing AAIConfig
2021-04-29 14:59:52.648 DEBUG 10 --- [ main] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2021-04-29 14:59:52.648 INFO 10 --- [ main] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2021-04-29 14:59:52.649 INFO 10 --- [ main] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename
2021-04-29 14:59:53.051 INFO 10 --- [ main] com.datastax.driver.core : DataStax Java driver 3.6.0 for Apache Cassandra
2021-04-29 14:59:53.063 INFO 10 --- [ main] c.d.driver.core.GuavaCompatibility : Detected Guava >= 19 in the classpath, using modern compatibility layer
2021-04-29 14:59:53.063 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NEW_NODE_DELAY_SECONDS is undefined, using default value 1
2021-04-29 14:59:53.063 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NOTIF_LOCK_TIMEOUT_SECONDS is undefined, using default value 60
2021-04-29 14:59:53.080 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2021-04-29 14:59:53.346 INFO 10 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2021-04-29 14:59:53.355 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NON_BLOCKING_EXECUTOR_SIZE is undefined, using default value 2
2021-04-29 14:59:53.443 DEBUG 10 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.242.76.214:9042]
2021-04-29 14:59:53.476 DEBUG 10 --- [ main] i.n.u.i.logging.InternalLoggerFactory : Using SLF4J as the default logging framework
2021-04-29 14:59:53.495 DEBUG 10 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024
2021-04-29 14:59:53.495 DEBUG 10 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096
2021-04-29 14:59:53.532 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : -Dio.netty.noUnsafe: false
2021-04-29 14:59:53.532 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : Java version: 8
2021-04-29 14:59:53.533 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.theUnsafe: available
2021-04-29 14:59:53.534 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.copyMemory: available
2021-04-29 14:59:53.535 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Buffer.address: available
2021-04-29 14:59:53.536 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : direct buffer constructor: available
2021-04-29 14:59:53.537 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Bits.unaligned: available, true
2021-04-29 14:59:53.537 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9
2021-04-29 14:59:53.537 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.DirectByteBuffer.(long, int): available
2021-04-29 14:59:53.537 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : sun.misc.Unsafe: available
2021-04-29 14:59:53.537 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
2021-04-29 14:59:53.537 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.bitMode: 64 (sun.arch.data.model)
2021-04-29 14:59:53.538 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.maxDirectMemory: 1020067840 bytes
2021-04-29 14:59:53.539 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.uninitializedArrayAllocationThreshold: -1
2021-04-29 14:59:53.540 DEBUG 10 --- [ main] io.netty.util.internal.CleanerJava6 : java.nio.ByteBuffer.cleaner(): available
2021-04-29 14:59:53.540 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.noPreferDirect: false
2021-04-29 14:59:53.546 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FORCE_NIO is undefined, using default value false
2021-04-29 14:59:53.551 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.workdir: /tmp (io.netty.tmpdir)
2021-04-29 14:59:53.551 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.deleteLibAfterLoading: true
2021-04-29 14:59:53.551 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.tryPatchShadedId: true
2021-04-29 14:59:53.556 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library 'netty_transport_native_epoll_x86_64', trying other loading mechanism.
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
2021-04-29 14:59:53.557 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : netty_transport_native_epoll_x86_64 cannot be loaded from java.library.path, now trying export to -Dio.netty.native.workdir: /tmp
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
2021-04-29 14:59:53.581 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library '/tmp/libnetty_transport_native_epoll_x86_648493495801969275938.so', trying other loading mechanism.
java.lang.UnsatisfiedLinkError: null
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:382)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:203)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
Caused by: java.lang.reflect.InvocationTargetException: null
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
... 65 common frames omitted
Caused by: java.lang.RuntimeException: failed to get field ID: DefaultFileRegion.transfered
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:36)
... 72 common frames omitted
2021-04-29 14:59:53.583 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library 'netty_transport_native_epoll', trying other loading mechanism.
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:290)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
2021-04-29 14:59:53.583 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : netty_transport_native_epoll cannot be loaded from java.library.path, now trying export to -Dio.netty.native.workdir: /tmp
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:290)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
2021-04-29 14:59:53.585 WARN 10 --- [ main] com.datastax.driver.core.NettyUtil : Found Netty's native epoll transport in the classpath, but epoll is not available. Using NIO instead.
java.lang.UnsatisfiedLinkError: could not load a native library: netty_transport_native_epoll_x86_64
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:224)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
... 63 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: could not load a native library: netty_transport_native_epoll
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:224)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:290)
... 62 common frames omitted
Caused by: java.io.FileNotFoundException: META-INF/native/libnetty_transport_native_epoll.so
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:173)
... 63 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
... 63 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
Caused by: java.lang.RuntimeException: failed to get field ID: DefaultFileRegion.transfered
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:36)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:203)
... 63 common frames omitted
2021-04-29 14:59:53.593 DEBUG 10 --- [ main] i.n.channel.MultithreadEventLoopGroup : -Dio.netty.eventLoopThreads: 4
2021-04-29 14:59:53.609 DEBUG 10 --- [ main] io.netty.channel.nio.NioEventLoop : -Dio.netty.noKeySetOptimization: false
2021-04-29 14:59:53.609 DEBUG 10 --- [ main] io.netty.channel.nio.NioEventLoop : -Dio.netty.selectorAutoRebuildThreshold: 512
2021-04-29 14:59:53.626 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : org.jctools-core.MpscChunkedArrayQueue: available
2021-04-29 14:59:53.650 DEBUG 10 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.level: simple
2021-04-29 14:59:53.650 DEBUG 10 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.targetRecords: 4
2021-04-29 14:59:53.650 DEBUG 10 --- [ main] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@14c7ab73
2021-04-29 14:59:53.658 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.EXTENDED_PEER_CHECK is undefined, using default value true
2021-04-29 14:59:53.708 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.76.214:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:53.713 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.DISABLE_COALESCING is undefined, using default value false
2021-04-29 14:59:53.713 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_SCHEDULE_PERIOD_NS is undefined, using default value 10000
2021-04-29 14:59:53.713 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_RUN_WITHOUT_WORK_TIMES is undefined, using default value 5
2021-04-29 14:59:53.775 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numHeapArenas: 4
2021-04-29 14:59:53.775 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numDirectArenas: 4
2021-04-29 14:59:53.775 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.pageSize: 8192
2021-04-29 14:59:53.775 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxOrder: 11
2021-04-29 14:59:53.775 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.chunkSize: 16777216
2021-04-29 14:59:53.775 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.tinyCacheSize: 512
2021-04-29 14:59:53.775 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.smallCacheSize: 256
2021-04-29 14:59:53.775 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.normalCacheSize: 64
2021-04-29 14:59:53.775 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxCachedBufferCapacity: 32768
2021-04-29 14:59:53.775 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.cacheTrimInterval: 8192
2021-04-29 14:59:53.776 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.cacheTrimIntervalMillis: 0
2021-04-29 14:59:53.776 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.useCacheForAllThreads: true
2021-04-29 14:59:53.776 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023
2021-04-29 14:59:53.812 DEBUG 10 --- [ main] io.netty.channel.DefaultChannelId : -Dio.netty.processId: 10 (auto-detected)
2021-04-29 14:59:53.815 DEBUG 10 --- [ main] io.netty.util.NetUtil : -Djava.net.preferIPv4Stack: false
2021-04-29 14:59:53.816 DEBUG 10 --- [ main] io.netty.util.NetUtil : -Djava.net.preferIPv6Addresses: false
2021-04-29 14:59:53.818 DEBUG 10 --- [ main] io.netty.util.NetUtil : Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo)
2021-04-29 14:59:53.819 DEBUG 10 --- [ main] io.netty.util.NetUtil : /proc/sys/net/core/somaxconn: 128
2021-04-29 14:59:53.820 DEBUG 10 --- [ main] io.netty.channel.DefaultChannelId : -Dio.netty.machineId: a6:7d:27:ff:fe:99:2f:29 (auto-detected)
2021-04-29 14:59:53.861 DEBUG 10 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.allocator.type: pooled
2021-04-29 14:59:53.862 DEBUG 10 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.threadLocalDirectBufferSize: 0
2021-04-29 14:59:53.862 DEBUG 10 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.maxThreadLocalCharBufferSize: 16384
2021-04-29 14:59:53.919 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:53.958 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxCapacityPerThread: 4096
2021-04-29 14:59:53.958 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxSharedCapacityFactor: 2
2021-04-29 14:59:53.958 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.linkCapacity: 16
2021-04-29 14:59:53.958 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.ratio: 8
2021-04-29 14:59:53.973 DEBUG 10 --- [er-nio-worker-0] io.netty.buffer.AbstractByteBuf : -Dio.netty.buffer.checkAccessible: true
2021-04-29 14:59:53.974 DEBUG 10 --- [er-nio-worker-0] io.netty.buffer.AbstractByteBuf : -Dio.netty.buffer.checkBounds: true
2021-04-29 14:59:53.974 DEBUG 10 --- [er-nio-worker-0] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@3f43784
2021-04-29 14:59:54.006 DEBUG 10 --- [er-nio-worker-0] c.datastax.driver.core.SystemProperties : com.datastax.driver.NATIVE_TRANSPORT_MAX_FRAME_SIZE_IN_MB is undefined, using default value 256
2021-04-29 14:59:54.236 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.76.214:9042] Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:54.238 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2021-04-29 14:59:54.315 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema
2021-04-29 14:59:54.433 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 14:59:54.443 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 10 milliseconds
2021-04-29 14:59:54.456 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.242.76.214:9042
2021-04-29 14:59:54.456 INFO 10 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor)
2021-04-29 14:59:54.458 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.64.133:9042 added
2021-04-29 14:59:54.458 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.226.88:9042 added
2021-04-29 14:59:54.458 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.242.76.214:9042 added
2021-04-29 14:59:54.462 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.CHECK_IO_DEADLOCKS is undefined, using default value true
2021-04-29 14:59:54.466 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:54.469 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:54.473 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:54.474 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.76.214:9042] preparing to open 1 new connections, total = 2
2021-04-29 14:59:54.475 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:54.475 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:54.630 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TYPE dox.user_candidate_version, scheduling delivery
2021-04-29 14:59:54.939 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.242.76.214:9042] Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:54.941 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.242.76.214:9042 (1 connections needed, 1 successfully opened)
2021-04-29 14:59:54.942 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for cassandra/10.242.76.214:9042
2021-04-29 14:59:55.151 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:55.151 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.64.133:9042 (1 connections needed, 1 successfully opened)
2021-04-29 14:59:55.151 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for /10.242.64.133:9042
2021-04-29 14:59:55.317 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED KEYSPACE workflow, scheduling delivery
2021-04-29 14:59:55.743 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:55.744 DEBUG 10 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.226.88:9042 (1 connections needed, 1 successfully opened)
2021-04-29 14:59:55.744 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Session : Added connection pool for /10.242.226.88:9042
2021-04-29 14:59:56.125 DEBUG 10 --- [ main] org.reflections.Reflections : going to scan these urls:
file:/opt/app/aai-traversal/resources/
2021-04-29 14:59:56.135 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ipsec-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.136 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ipsec-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.136 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.136 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.137 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/reserved-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.137 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/reserved-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.137 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tagged-inventory-item-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.137 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tagged-inventory-item-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.137 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.138 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.138 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/constrained-element-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.138 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/constrained-element-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.138 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tenant-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.138 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tenant-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.138 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.139 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.139 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.139 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.139 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vf-module-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.140 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vf-module-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.140 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/newvce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.140 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/newvce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.140 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/customer-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.140 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/customer-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.140 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vig-server-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.141 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vig-server-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.141 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnf-image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.141 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnf-image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.141 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/snapshot-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.141 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/snapshot-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.142 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv4-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.142 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv4-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.142 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.142 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.142 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.143 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.143 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/oam-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.143 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/oam-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.143 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/entitlement-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.143 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/entitlement-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.143 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.144 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.144 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.144 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.144 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/collection-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.144 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/collection-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.145 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/result-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.145 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/result-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.145 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/allotted-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.145 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/allotted-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.145 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/group-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.145 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/group-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.146 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.146 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.146 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-key-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.146 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-key-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.146 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/update-node-key-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.146 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/update-node-key-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.147 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cloud-region-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.147 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cloud-region-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.147 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.147 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.147 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/route-table-reference-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.148 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/route-table-reference-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.148 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cvlan-tag-entry-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.148 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cvlan-tag-entry-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.148 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-capability-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.148 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-capability-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.148 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.149 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.149 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/connector-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.149 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/connector-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.149 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/segmentation-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.149 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/segmentation-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.149 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/property-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.150 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/property-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.150 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.150 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.150 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/routing-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.150 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/routing-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.150 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.151 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.151 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/related-lookup-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.151 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/related-lookup-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.151 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/class-of-service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.151 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/class-of-service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.152 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/key-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.152 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/key-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.152 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-policy-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.152 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-policy-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.152 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.152 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.153 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.153 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.153 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/logical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.153 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/logical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.153 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpn-binding-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.153 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpn-binding-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.154 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.154 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.154 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/instance-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.154 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/instance-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.154 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/start-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.155 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/start-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.155 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.155 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.155 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.155 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.156 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.156 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.156 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.156 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.156 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-profile-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.156 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-profile-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.157 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.157 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.157 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/port-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.157 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/port-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.157 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/multicast-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.157 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/multicast-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.158 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/p-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.158 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/p-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.158 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/physical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.158 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/physical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.158 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/generic-vnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.159 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/generic-vnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.159 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.159 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.159 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/az-and-dvs-switches-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.159 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/az-and-dvs-switches-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.159 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/virtual-data-center-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.160 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/virtual-data-center-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.160 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv6-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.160 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv6-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.160 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/secondary-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.160 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/secondary-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.160 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vlan-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.161 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vlan-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.161 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.161 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.161 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/edge-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.161 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/edge-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.161 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/metadatum-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.162 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/metadatum-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.162 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/availability-zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.162 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/availability-zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.162 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/dvs-switch-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.162 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/dvs-switch-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.162 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.162 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.163 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.163 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.163 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.163 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.163 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.163 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.164 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/subnet-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.164 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/subnet-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.164 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/include-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.164 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/include-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.164 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnfc-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.164 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnfc-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.164 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/flavor-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.165 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/flavor-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.165 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.165 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.165 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/complex-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.165 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/complex-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.166 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-pool-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.166 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-pool-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.166 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/element-choice-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.166 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/element-choice-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.166 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.166 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.166 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpls-pe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.167 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpls-pe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.167 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-subscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.167 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-subscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.167 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.167 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.167 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/sriov-vf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.168 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/sriov-vf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.168 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tunnel-xconnect-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.168 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tunnel-xconnect-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.168 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-ver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.168 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-ver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.169 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/service-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.169 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/service-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.169 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/resource-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.169 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/resource-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.169 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.170 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.170 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.170 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.170 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology2-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.170 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology2-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.170 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.171 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.171 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/closed-loop-named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.171 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/closed-loop-named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.171 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcInstance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.171 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcInstance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.171 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.171 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.172 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcSubscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.172 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcSubscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.172 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.2.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.172 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.2.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.172 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceModel-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.172 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceModel-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.172 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getWlBundleId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.173 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getWlBundleId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.173 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLinkByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.173 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLinkByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.173 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexLocationId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.173 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexLocationId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.173 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getRouterRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.173 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getRouterRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.174 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.174 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.174 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getLogicalLinkByCloudRegionId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.174 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getLogicalLinkByCloudRegionId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.174 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.174 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.175 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getSvcSubscriberModelInfo-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.175 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getSvcSubscriberModelInfo-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.175 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getL3networkCloudRegionByNetworkRole-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.175 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getL3networkCloudRegionByNetworkRole-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.175 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getClfiRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.175 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getClfiRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.175 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVnfVlanByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.176 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVnfVlanByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.176 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexHostname-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.176 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexHostname-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.176 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getPinterfacePhysicalLinkBySvcInstId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.176 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getPinterfacePhysicalLinkBySvcInstId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.176 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLink-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.176 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLink-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.176 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.177 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.177 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.177 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.177 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComplexByPnfName-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.177 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComplexByPnfName-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.177 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.177 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.178 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.178 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.178 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.178 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.178 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.178 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.179 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.179 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.179 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.179 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.179 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.179 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.180 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.180 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.180 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/query/stored-queries.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.180 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/query/stored-queries.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.181 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.181 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.181 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.181 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.182 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.182 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.182 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.182 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.183 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.183 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.183 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.183 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.183 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.184 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.221 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.221 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.221 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.221 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.222 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.222 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.222 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.222 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.222 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.222 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.223 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.223 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.223 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.223 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.224 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.224 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.224 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.224 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.224 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.224 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.225 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.225 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.225 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.225 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.225 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.225 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.226 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.226 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.226 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.226 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.226 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.226 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.226 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.226 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.227 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.227 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.227 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.227 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.227 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.227 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.227 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.227 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.228 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.228 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.228 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.228 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.228 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.228 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.228 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.229 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.229 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.229 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.229 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.229 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.229 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.229 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.230 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.230 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.230 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.230 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.230 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.230 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.231 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.231 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.231 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.231 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.232 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.232 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.232 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.232 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.232 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.233 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.233 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.233 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.233 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.233 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.234 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.234 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.234 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.234 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.234 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.235 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.243 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.243 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.243 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.243 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.243 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.243 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.244 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.244 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.244 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.244 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.244 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.244 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.244 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.244 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.245 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.245 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.245 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.245 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.245 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.245 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.245 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.246 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.246 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.246 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.246 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.246 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.246 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.246 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.246 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.247 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.247 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.247 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.247 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.247 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.247 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.247 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.248 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.248 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.248 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.248 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.248 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.248 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.248 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.249 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.249 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.249 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.249 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.249 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.249 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.249 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.249 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.250 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.250 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.250 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.250 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.250 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.250 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.250 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.250 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.251 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.251 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.251 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.251 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.251 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.251 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.251 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.251 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.251 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.252 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.252 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.252 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.252 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.252 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.252 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.252 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.253 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.253 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/bath_config.csv in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.253 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/bath_config.csv in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.253 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/permissions.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.253 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/permissions.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.253 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.253 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.254 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.254 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.254 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.254 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.254 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.254 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.254 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.255 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.255 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.255 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.255 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.255 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.255 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.255 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.255 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.256 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.256 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.256 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.256 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.256 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.257 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v1/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.257 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v1/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.257 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v2/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.257 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v2/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.257 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.257 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.257 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.257 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.258 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file cadi.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.258 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file cadi.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.258 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2021-04-29 14:59:56.258 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2021-04-29 14:59:56.258 INFO 10 --- [ main] org.reflections.Reflections : Reflections took 133 ms to scan 1 urls, producing 0 keys and 0 values
2021-04-29 14:59:56.320 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 14:59:56.408 DEBUG 10 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 14:59:56.418 DEBUG 10 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 10 milliseconds
2021-04-29 14:59:56.529 DEBUG 10 --- [ main] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=true] closing connection
2021-04-29 14:59:56.529 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-1, inFlight=0, closed=true] closed, remaining = 0
2021-04-29 14:59:56.532 DEBUG 10 --- [ main] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=true] closing connection
2021-04-29 14:59:56.532 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-1, inFlight=0, closed=true] closed, remaining = 0
2021-04-29 14:59:56.533 DEBUG 10 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=true] closing connection
2021-04-29 14:59:56.533 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.76.214:9042] Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=true] closed, remaining = 1
2021-04-29 14:59:56.534 DEBUG 10 --- [ main] com.datastax.driver.core.Cluster : Shutting down
2021-04-29 14:59:56.535 DEBUG 10 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=true] closing connection
2021-04-29 14:59:56.536 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.76.214:9042] Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=true] closed, remaining = 0
2021-04-29 14:59:58.549 DEBUG 10 --- [er-nio-worker-0] io.netty.buffer.PoolThreadCache : Freed 37 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-0
2021-04-29 14:59:58.549 DEBUG 10 --- [er-nio-worker-1] io.netty.buffer.PoolThreadCache : Freed 21 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-1
2021-04-29 14:59:58.565 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2021-04-29 14:59:58.565 INFO 10 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2021-04-29 14:59:58.566 DEBUG 10 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.242.76.214:9042]
2021-04-29 14:59:58.569 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.76.214:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:58.571 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:59.335 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.76.214:9042] Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:59.336 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2021-04-29 14:59:59.346 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema
2021-04-29 14:59:59.455 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 14:59:59.461 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds
2021-04-29 14:59:59.469 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.242.76.214:9042
2021-04-29 14:59:59.469 INFO 10 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor)
2021-04-29 14:59:59.469 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.64.133:9042 added
2021-04-29 14:59:59.469 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.226.88:9042 added
2021-04-29 14:59:59.469 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.242.76.214:9042 added
2021-04-29 14:59:59.469 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:59.470 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 14:59:59.471 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.76.214:9042] preparing to open 1 new connections, total = 2
2021-04-29 14:59:59.471 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:59.471 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:59.473 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 14:59:59.690 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 14:59:59.691 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.64.133:9042 (1 connections needed, 1 successfully opened)
2021-04-29 14:59:59.691 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for /10.242.64.133:9042
2021-04-29 15:00:00.025 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.version_info, scheduling delivery
2021-04-29 15:00:00.117 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.242.76.214:9042] Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 15:00:00.117 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.242.76.214:9042 (1 connections needed, 1 successfully opened)
2021-04-29 15:00:00.117 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for cassandra/10.242.76.214:9042
2021-04-29 15:00:00.740 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 15:00:00.740 DEBUG 10 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.226.88:9042 (1 connections needed, 1 successfully opened)
2021-04-29 15:00:00.740 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Session : Added connection pool for /10.242.226.88:9042
2021-04-29 15:00:00.851 DEBUG 10 --- [er-nio-worker-0] io.netty.channel.nio.NioEventLoop : Selector.select() returned prematurely 3 times in a row for Selector io.netty.channel.nio.SelectedSelectionKeySetSelector@49c818ba.
2021-04-29 15:00:01.025 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.version_info (TABLE)
2021-04-29 15:00:01.259 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.version_info_deleted, scheduling delivery
2021-04-29 15:00:01.546 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE workflow.unique_value, scheduling delivery
2021-04-29 15:00:01.949 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Processing the translator
2021-04-29 15:00:01.951 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv11
2021-04-29 15:00:01.951 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:01.951 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v11, BODY=
2021-04-29 15:00:01.953 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:01.953 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:01.953 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:01.953 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:01.985 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:01.986 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:01.987 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:01.987 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv12
2021-04-29 15:00:01.987 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:01.987 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v12, BODY=
2021-04-29 15:00:01.988 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:01.988 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:01.988 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:01.988 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.001 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.002 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.002 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.003 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv13
2021-04-29 15:00:02.003 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.003 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v13, BODY=
2021-04-29 15:00:02.004 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.004 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.004 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.004 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.012 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.014 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.014 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.014 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv14
2021-04-29 15:00:02.014 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.015 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v14, BODY=
2021-04-29 15:00:02.016 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.016 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.016 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.016 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.025 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.028 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.028 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.028 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv15
2021-04-29 15:00:02.028 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.029 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v15, BODY=
2021-04-29 15:00:02.030 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.030 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.030 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.030 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.039 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.041 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.041 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.041 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv16
2021-04-29 15:00:02.042 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.042 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v16, BODY=
2021-04-29 15:00:02.043 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.043 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.043 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.043 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.052 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.054 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.054 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.055 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv17
2021-04-29 15:00:02.055 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.055 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v17, BODY=
2021-04-29 15:00:02.056 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.056 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.056 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.056 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.066 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.068 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.069 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.069 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv18
2021-04-29 15:00:02.069 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.069 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v18, BODY=
2021-04-29 15:00:02.070 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.070 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.070 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.070 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.083 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.085 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.086 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.086 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv19
2021-04-29 15:00:02.086 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.086 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v19, BODY=
2021-04-29 15:00:02.087 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.087 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.087 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.087 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.098 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.101 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.101 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.101 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv20
2021-04-29 15:00:02.102 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.102 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v20, BODY=
2021-04-29 15:00:02.103 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.103 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.103 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.103 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.116 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.120 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.121 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.122 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv21
2021-04-29 15:00:02.122 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.123 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v21, BODY=
2021-04-29 15:00:02.125 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.125 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.125 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.125 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.144 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.149 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.149 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.150 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv22
2021-04-29 15:00:02.150 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.150 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v22, BODY=
2021-04-29 15:00:02.151 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.151 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.151 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.151 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.172 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.179 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.179 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.180 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv23
2021-04-29 15:00:02.180 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.181 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v23, BODY=
2021-04-29 15:00:02.182 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.182 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.182 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.182 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.198 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.203 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2021-04-29 15:00:02.203 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2021-04-29 15:00:02.316 INFO 10 --- [ main] o.o.a.rest.search.SchemaServiceCQConfig : Calling the SchemaService to retrieve stored queries
2021-04-29 15:00:02.317 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2021-04-29 15:00:02.317 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/stored-queries, BODY=
2021-04-29 15:00:02.319 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2021-04-29 15:00:02.319 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2021-04-29 15:00:02.319 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2021-04-29 15:00:02.319 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2021-04-29 15:00:02.344 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2021-04-29 15:00:02.547 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:02.592 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:02.598 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds
2021-04-29 15:00:02.838 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.unique_value, scheduling delivery
2021-04-29 15:00:02.920 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Found javax.persistence.Persistence on classpath containing 'getPersistenceUtil'. Assuming JPA 2 environment. Trying to instantiate JPA aware TraversableResolver
2021-04-29 15:00:02.920 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Instantiated JPA aware TraversableResolver of type org.hibernate.validator.internal.engine.resolver.JPATraversableResolver.
2021-04-29 15:00:02.920 DEBUG 10 --- [ main] .h.v.m.ResourceBundleMessageInterpolator : Loaded expression factory via original TCCL
2021-04-29 15:00:02.922 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Found javax.persistence.Persistence on classpath containing 'getPersistenceUtil'. Assuming JPA 2 environment. Trying to instantiate JPA aware TraversableResolver
2021-04-29 15:00:02.922 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Instantiated JPA aware TraversableResolver of type org.hibernate.validator.internal.engine.resolver.JPATraversableResolver.
2021-04-29 15:00:02.923 DEBUG 10 --- [ main] o.h.v.internal.engine.ConfigurationImpl : Setting custom MessageInterpolator of type org.springframework.validation.beanvalidation.LocaleContextMessageInterpolator
2021-04-29 15:00:02.924 DEBUG 10 --- [ main] o.h.v.internal.engine.ConfigurationImpl : Setting custom ConstraintValidatorFactory of type org.springframework.validation.beanvalidation.SpringConstraintValidatorFactory
2021-04-29 15:00:02.924 DEBUG 10 --- [ main] o.h.v.internal.engine.ConfigurationImpl : Setting custom ParameterNameProvider of type org.springframework.validation.beanvalidation.LocalValidatorFactoryBean$1
2021-04-29 15:00:02.926 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : Trying to load META-INF/validation.xml for XML based Validator configuration.
2021-04-29 15:00:02.926 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via user class loader
2021-04-29 15:00:02.926 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via TCCL
2021-04-29 15:00:02.927 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via Hibernate Validator's class loader
2021-04-29 15:00:02.927 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : No META-INF/validation.xml found. Using annotation based configuration only.
2021-04-29 15:00:02.940 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.springframework.validation.beanvalidation.LocaleContextMessageInterpolator as ValidatorFactory-scoped message interpolator.
2021-04-29 15:00:02.940 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.resolver.JPATraversableResolver as ValidatorFactory-scoped traversable resolver.
2021-04-29 15:00:02.940 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.util.ExecutableParameterNameProvider as ValidatorFactory-scoped parameter name provider.
2021-04-29 15:00:02.941 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.DefaultClockProvider as ValidatorFactory-scoped clock provider.
2021-04-29 15:00:02.941 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.scripting.DefaultScriptEvaluatorFactory as ValidatorFactory-scoped script evaluator factory.
2021-04-29 15:00:03.546 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2021-04-29 15:00:03.546 INFO 10 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2021-04-29 15:00:03.554 WARN 10 --- [ main] .b.a.g.t.GroovyTemplateAutoConfiguration : Cannot find template location: classpath:/templates/ (please add some templates, check your Groovy configuration, or set spring.groovy.template.check-template-location=false)
2021-04-29 15:00:03.839 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.unique_value (TABLE)
2021-04-29 15:00:03.902 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.package_details, scheduling delivery
2021-04-29 15:00:04.210 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.item, scheduling delivery
2021-04-29 15:00:05.223 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:05.311 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:05.317 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds
2021-04-29 15:00:05.531 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_enriched_service_template, scheduling delivery
2021-04-29 15:00:05.925 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.version, scheduling delivery
2021-04-29 15:00:06.274 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Found javax.persistence.Persistence on classpath containing 'getPersistenceUtil'. Assuming JPA 2 environment. Trying to instantiate JPA aware TraversableResolver
2021-04-29 15:00:06.274 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Instantiated JPA aware TraversableResolver of type org.hibernate.validator.internal.engine.resolver.JPATraversableResolver.
2021-04-29 15:00:06.276 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : Trying to load META-INF/validation.xml for XML based Validator configuration.
2021-04-29 15:00:06.276 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via TCCL
2021-04-29 15:00:06.277 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via Hibernate Validator's class loader
2021-04-29 15:00:06.277 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : No META-INF/validation.xml found. Using annotation based configuration only.
2021-04-29 15:00:06.310 DEBUG 10 --- [ main] .h.v.m.ResourceBundleMessageInterpolator : Loaded expression factory via original TCCL
2021-04-29 15:00:06.311 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.messageinterpolation.ResourceBundleMessageInterpolator as ValidatorFactory-scoped message interpolator.
2021-04-29 15:00:06.311 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.resolver.JPATraversableResolver as ValidatorFactory-scoped traversable resolver.
2021-04-29 15:00:06.311 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.util.ExecutableParameterNameProvider as ValidatorFactory-scoped parameter name provider.
2021-04-29 15:00:06.311 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.DefaultClockProvider as ValidatorFactory-scoped clock provider.
2021-04-29 15:00:06.311 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.scripting.DefaultScriptEvaluatorFactory as ValidatorFactory-scoped script evaluator factory.
2021-04-29 15:00:06.417 WARN 10 --- [ main] org.glassfish.jersey.internal.Errors : The following warnings have been detected: WARNING: The (sub)resource method getC2Qgremlin in org.onap.aai.rest.CQ2Gremlin contains empty path annotation.
WARNING: The (sub)resource method getC2Qgremlin in org.onap.aai.rest.CQ2GremlinTest contains empty path annotation.
WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.onap.aai.rest.RecentAPIConsumer.getRecentData(java.lang.String,java.lang.String,java.lang.String,javax.ws.rs.core.HttpHeaders,javax.servlet.http.HttpServletRequest,javax.ws.rs.core.UriInfo), should not consume any entity.
2021-04-29 15:00:06.426 DEBUG 10 --- [ main] org.onap.aai.config.ErrorHandler : Filter 'errorHandler' configured for use
2021-04-29 15:00:06.847 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.version_elements, scheduling delivery
2021-04-29 15:00:06.875 INFO 10 --- [ main] org.onap.aai.TraversalApp : Application 'aai-traversal' is running on 8446!
2021-04-29 15:00:06.875 DEBUG 10 --- [ main] org.onap.aai.TraversalApp : Traversal MicroService Started
Traversal Microservice Started
2021-04-29 15:00:07.081 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_enriched_service_artifact, scheduling delivery
2021-04-29 15:00:08.082 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:08.115 DEBUG 10 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:08.121 DEBUG 10 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds
2021-04-29 15:00:09.117 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element_namespace, scheduling delivery
2021-04-29 15:00:09.746 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.application_config, scheduling delivery
2021-04-29 15:00:10.747 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:10.951 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:10.958 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 7 milliseconds
2021-04-29 15:00:11.425 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element, scheduling delivery
2021-04-29 15:00:12.425 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_workflow.element (TABLE)
2021-04-29 15:00:13.432 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element_synchronization_state, scheduling delivery
2021-04-29 15:00:14.432 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_workflow.element_synchronization_state (TABLE)
2021-04-29 15:00:14.956 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:15.524 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.element_stage, scheduling delivery
2021-04-29 15:00:16.525 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:16.557 DEBUG 10 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:16.563 DEBUG 10 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds
2021-04-29 15:00:17.522 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_workflow.version_stage, scheduling delivery
2021-04-29 15:00:18.523 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_workflow.version_stage (TABLE)
2021-04-29 15:00:18.619 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:19.619 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2021-04-29 15:00:22.208 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:23.208 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2021-04-29 15:00:23.573 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:24.573 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2021-04-29 15:00:24.620 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:25.620 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2021-04-29 15:00:26.011 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:27.012 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2021-04-29 15:00:27.380 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.ecompcomponent, scheduling delivery
2021-04-29 15:00:28.380 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.ecompcomponent (TABLE)
2021-04-29 15:00:29.943 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2021-04-29 15:00:30.943 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2021-04-29 15:00:31.867 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:00:31.917 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:00:32.630 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.action_artifact, scheduling delivery
2021-04-29 15:00:33.630 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action_artifact (TABLE)
2021-04-29 15:00:34.462 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.activity_log, scheduling delivery
2021-04-29 15:00:35.463 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.activity_log (TABLE)
2021-04-29 15:00:36.431 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.healing, scheduling delivery
2021-04-29 15:00:37.431 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.healing (TABLE)
2021-04-29 15:00:37.623 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.migration, scheduling delivery
2021-04-29 15:00:38.623 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.migration (TABLE)
2021-04-29 15:00:39.008 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.item_permissions, scheduling delivery
2021-04-29 15:00:39.357 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.user_permission_items, scheduling delivery
2021-04-29 15:00:40.358 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox
2021-04-29 15:00:40.368 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:40.373 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 5 milliseconds
2021-04-29 15:00:40.445 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.notification_subscribers, scheduling delivery
2021-04-29 15:00:41.291 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.last_notification, scheduling delivery
2021-04-29 15:00:42.292 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox
2021-04-29 15:00:42.299 DEBUG 10 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:42.313 DEBUG 10 --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 14 milliseconds
2021-04-29 15:00:42.965 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.notifications, scheduling delivery
2021-04-29 15:00:43.898 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_merge_hint, scheduling delivery
2021-04-29 15:00:44.563 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.item, scheduling delivery
2021-04-29 15:00:45.405 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version, scheduling delivery
2021-04-29 15:00:46.309 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version_elements, scheduling delivery
2021-04-29 15:00:47.310 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null)
2021-04-29 15:00:47.330 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:00:47.333 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 3 milliseconds
2021-04-29 15:00:47.441 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_namespace, scheduling delivery
2021-04-29 15:00:48.441 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.element_namespace (TABLE)
2021-04-29 15:00:50.317 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element, scheduling delivery
2021-04-29 15:00:51.317 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.element (TABLE)
2021-04-29 15:00:52.124 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_synchronization_state, scheduling delivery
2021-04-29 15:00:53.125 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.element_synchronization_state (TABLE)
2021-04-29 15:00:53.589 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_stage, scheduling delivery
2021-04-29 15:00:54.589 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.element_stage (TABLE)
2021-04-29 15:00:55.067 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version_stage, scheduling delivery
2021-04-29 15:00:56.068 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.version_stage (TABLE)
2021-04-29 15:01:01.918 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:01:01.920 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:01:17.603 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:01:17.605 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:01:26.120 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:01:26.124 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:01:37.671 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:01:37.735 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:01:56.139 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:01:56.140 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:01:57.711 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:01:57.715 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:02:07.918 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:02:07.936 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:02:26.142 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:02:26.144 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:02:48.201 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:02:48.205 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:02:56.146 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:02:56.148 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:03:18.279 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:03:18.289 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:03:26.149 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:03:26.150 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:03:56.151 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:03:56.216 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:04:08.527 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:04:08.534 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:04:26.217 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:04:26.219 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:04:48.571 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:04:48.593 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:04:56.220 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:04:56.223 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:05:18.595 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:05:18.599 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:05:26.227 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:05:26.229 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:05:56.241 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:05:56.245 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:06:08.872 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:06:08.875 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:06:26.247 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:06:26.249 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:06:53.958 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:06:53.990 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:06:56.259 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:06:56.315 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:07:26.317 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:07:26.320 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:07:56.321 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:07:56.322 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:08:26.324 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:08:26.328 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:08:39.547 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:08:39.551 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:08:56.335 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:08:56.417 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:09:14.903 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:09:14.936 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:09:26.418 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:09:26.420 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:09:56.421 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:09:56.423 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:10:26.423 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:10:26.425 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:10:35.627 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:10:35.629 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:10:56.426 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:10:56.427 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:11:05.639 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:11:05.643 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:11:26.428 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:11:26.431 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:11:49.197 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:11:49.210 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:11:56.448 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:11:56.450 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:11:59.239 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:11:59.241 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:12:26.459 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:12:26.461 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:12:29.267 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:12:29.269 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:12:56.488 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:12:56.516 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:12:59.270 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:12:59.272 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:13:18.299 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:13:19.354 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:13:26.517 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:13:26.519 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:13:56.523 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:13:56.524 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:14:13.503 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:14:13.505 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:14:26.531 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:14:26.533 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:14:46.623 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:14:46.624 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:14:56.538 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:14:56.540 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:15:15.220 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:15:15.330 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:15:26.541 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:15:26.543 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:15:45.331 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:15:45.394 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:15:45.417 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:15:45.418 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:15:56.543 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:15:56.545 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:16:15.420 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:16:15.422 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:16:26.547 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:16:26.548 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:16:45.424 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:16:45.428 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:16:56.552 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:16:56.554 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:17:11.672 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:17:11.675 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:17:26.561 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:17:26.563 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:17:43.444 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:17:55.472 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-1, inFlight=1, closed=false] because: [/10.242.64.133:9042] Heartbeat query timed out
2021-04-29 15:17:55.475 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preventing new connections for the next 1000 ms
2021-04-29 15:17:55.475 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-1, inFlight=1, closed=false] failed, remaining = 0
2021-04-29 15:17:55.477 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=1, closed=true] closing connection
2021-04-29 15:17:55.477 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.64.133:9042-1, inFlight=1, closed=true]: there are still pending requests
2021-04-29 15:17:55.477 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] marking host DOWN
2021-04-29 15:17:55.478 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.RequestHandler : onException triggered but the response was completed by another thread, cancelling (retryCount = 0, queryState = QueryState(count=0, inProgress=false, cancelled=false), queryStateRef = QueryState(count=0, inProgress=false, cancelled=false))
2021-04-29 15:17:55.479 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [399188518-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6030f147 at consistency LOCAL_QUORUM
2021-04-29 15:17:55.479 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [399188518-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.TransportException: [/10.242.64.133:9042] Connection has been closed
2021-04-29 15:17:55.485 DEBUG 10 --- [luster-worker-2] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:17:55.486 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] starting reconnection attempt
2021-04-29 15:17:56.486 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:17:56.488 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:17:56.576 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:17:56.578 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:18:10.721 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 15:18:10.722 DEBUG 10 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.64.133:9042
2021-04-29 15:18:10.726 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Successful reconnection to /10.242.64.133:9042, setting host UP
2021-04-29 15:18:10.726 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] marking host UP
2021-04-29 15:18:10.727 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2021-04-29 15:18:10.727 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.64.133:9042
2021-04-29 15:18:11.410 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 0 new connections, total = 1
2021-04-29 15:18:11.410 DEBUG 10 --- [-reconnection-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.64.133:9042 (1 connections needed, 1 successfully opened)
2021-04-29 15:18:11.411 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Session : Added connection pool for /10.242.64.133:9042
2021-04-29 15:18:11.412 DEBUG 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2021-04-29 15:18:27.573 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2071249260-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@25327325 at consistency LOCAL_QUORUM
2021-04-29 15:18:27.574 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2071249260-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:18:28.585 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-1, inFlight=0, closed=true] has already terminated
2021-04-29 15:18:40.729 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:18:40.731 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:18:41.411 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:18:41.858 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=1, closed=false] heartbeat query succeeded
2021-04-29 15:18:49.672 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1804895034-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@b854c96 at consistency LOCAL_QUORUM
2021-04-29 15:18:49.672 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1804895034-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:18:57.588 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:18:57.635 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:19:00.939 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.64.133:9042, scheduling delivery
2021-04-29 15:19:00.940 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] received event DOWN
2021-04-29 15:19:01.944 DEBUG 10 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.64.133:9042 because it still has active connections
2021-04-29 15:19:03.098 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] Response received on stream 3712 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:19:03.099 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] Response received on stream 3648 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:19:26.773 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1167603621-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@145d1371 at consistency LOCAL_QUORUM
2021-04-29 15:19:26.773 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1167603621-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:19:30.947 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:19:30.954 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:19:33.113 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:19:34.751 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:19:34.752 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:19:45.103 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:19:49.322 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=1, closed=false] Response received on stream 3840 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:19:58.972 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2094062796-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@73007274 at consistency LOCAL_QUORUM
2021-04-29 15:19:58.972 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [2094062796-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:20:00.954 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:20:00.957 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:20:11.955 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:20:11.958 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:20:19.333 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:20:21.073 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [333759686-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@451d8c6a at consistency LOCAL_QUORUM
2021-04-29 15:20:21.073 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [333759686-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:20:23.703 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] Response received on stream 3968 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:20:23.706 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:20:30.958 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:20:30.959 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:20:43.655 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=1, closed=false] Response received on stream 4032 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:20:48.173 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1417124358-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@645d89a3 at consistency LOCAL_QUORUM
2021-04-29 15:20:48.173 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1417124358-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:20:49.440 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] Response received on stream 4160 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:20:56.156 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:20:56.157 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:20:59.269 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:20:35.662Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:21:00.967 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:21:00.968 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:21:21.035 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:21:08.776Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:21:30.971 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:21:31.016 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:21:31.809 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [35629542-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@197701d4 at consistency null
2021-04-29 15:21:31.810 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [35629542-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:22:01.018 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:22:01.019 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:22:01.820 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:22:05.990 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:22:13.714 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1896263954-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2ba0c21e at consistency null
2021-04-29 15:22:13.714 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1896263954-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:22:28.822 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [688682375-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2998e12b at consistency null
2021-04-29 15:22:28.822 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [688682375-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:22:31.021 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:22:31.023 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:22:44.498 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1216676523-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@232bc365 at consistency null
2021-04-29 15:22:44.498 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1216676523-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:22:52.810 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1317054653-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4111a078 at consistency null
2021-04-29 15:22:52.810 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.RequestHandler : [1317054653-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:23:01.030 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:23:01.032 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:23:04.115 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:23:04.116 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:23:09.872 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [82463911-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@18e7d8c2 at consistency LOCAL_QUORUM
2021-04-29 15:23:09.872 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [82463911-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:23:11.392 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] Response received on stream 4736 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR UNAVAILABLE: Cannot achieve consistency level LOCAL_QUORUM
2021-04-29 15:23:22.823 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:23:22.826 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:23:31.040 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:23:31.043 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:23:34.973 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [356811720-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@68049a78 at consistency LOCAL_QUORUM
2021-04-29 15:23:34.974 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [356811720-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.64.133:9042] Timed out waiting for server response
2021-04-29 15:23:41.409 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:23:53.472 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-2, inFlight=1, closed=false] because: [/10.242.64.133:9042] Heartbeat query timed out
2021-04-29 15:23:53.472 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preventing new connections for the next 1000 ms
2021-04-29 15:23:53.472 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-2, inFlight=1, closed=false] failed, remaining = 0
2021-04-29 15:23:53.473 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=1, closed=true] closing connection
2021-04-29 15:23:53.473 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.64.133:9042-2, inFlight=1, closed=true]: there are still pending requests
2021-04-29 15:23:53.473 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [143914135-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6fcc4ce5 at consistency LOCAL_QUORUM
2021-04-29 15:23:53.474 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [143914135-0] Error querying /10.242.64.133:9042 : com.datastax.driver.core.exceptions.TransportException: [/10.242.64.133:9042] Connection has been closed
2021-04-29 15:23:53.474 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] marking host DOWN
2021-04-29 15:23:53.475 DEBUG 10 --- [luster-worker-3] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:23:53.475 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] starting reconnection attempt
2021-04-29 15:23:54.475 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:23:54.479 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-3, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:23:59.420 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-3, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:23:59.420 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-3, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:23:59.421 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-3, inFlight=0, closed=true] closing connection
2021-04-29 15:23:59.421 DEBUG 10 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:23:59.422 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-3, inFlight=0, closed=true] has already terminated
2021-04-29 15:23:59.422 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:23:59.423 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:23:59.424 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 2000 ms
2021-04-29 15:24:01.044 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:24:01.046 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:24:01.424 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:24:01.426 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-4, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:24:01.693 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-4, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:24:01.694 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-4, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:24:01.694 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-4, inFlight=0, closed=true] closing connection
2021-04-29 15:24:01.694 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:24:01.695 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-4, inFlight=0, closed=true] has already terminated
2021-04-29 15:24:01.695 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:24:01.695 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:24:01.696 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 4000 ms
2021-04-29 15:24:04.994 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:24:04.996 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:24:05.697 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:24:05.698 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-5, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:24:09.297 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-5, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:24:09.298 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-5, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:24:09.298 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-5, inFlight=0, closed=true] closing connection
2021-04-29 15:24:09.298 DEBUG 10 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:24:09.299 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-5, inFlight=0, closed=true] has already terminated
2021-04-29 15:24:09.299 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:24:09.299 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:24:09.300 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 8000 ms
2021-04-29 15:24:17.301 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:24:17.302 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-6, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:24:21.896 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-6, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:24:21.896 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-6, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:24:21.896 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-6, inFlight=0, closed=true] closing connection
2021-04-29 15:24:21.896 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:24:21.896 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-6, inFlight=0, closed=true] has already terminated
2021-04-29 15:24:21.897 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:24:21.897 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:24:21.898 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 16000 ms
2021-04-29 15:24:28.590 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-2, inFlight=0, closed=true] has already terminated
2021-04-29 15:24:31.047 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:24:31.049 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:24:37.898 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:24:37.900 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-7, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:24:38.205 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-7, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:24:38.205 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-7, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:24:38.205 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-7, inFlight=0, closed=true] closing connection
2021-04-29 15:24:38.205 DEBUG 10 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:24:38.206 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-7, inFlight=0, closed=true] has already terminated
2021-04-29 15:24:38.206 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:24:38.206 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 32000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:24:38.207 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 32000 ms
2021-04-29 15:25:00.804 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.64.133:9042, scheduling delivery
2021-04-29 15:25:00.804 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] received event UP
2021-04-29 15:25:01.805 DEBUG 10 --- [luster-worker-5] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.64.133:9042
2021-04-29 15:25:01.810 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] marking host UP
2021-04-29 15:25:01.810 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2021-04-29 15:25:01.810 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.64.133:9042
2021-04-29 15:25:01.810 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:25:01.811 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-8, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:25:02.616 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-8, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:02.616 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-8, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:25:02.616 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-8, inFlight=0, closed=true] closing connection
2021-04-29 15:25:02.617 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-8, inFlight=0, closed=true] has already terminated
2021-04-29 15:25:02.617 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:25:02.620 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-9, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:25:02.701 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-9, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:02.701 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-9, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:25:02.701 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-9, inFlight=0, closed=true] closing connection
2021-04-29 15:25:02.707 WARN 10 --- [er-nio-worker-0] com.datastax.driver.core.Session : Error creating pool to /10.242.64.133:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:25:02.708 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-9, inFlight=0, closed=true] has already terminated
2021-04-29 15:25:02.708 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Connection pool cannot be created, not marking /10.242.64.133:9042 UP
2021-04-29 15:25:02.708 DEBUG 10 --- [luster-worker-4] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] marking host DOWN
2021-04-29 15:25:02.708 DEBUG 10 --- [luster-worker-4] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:25:02.708 DEBUG 10 --- [luster-worker-4] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] starting reconnection attempt
2021-04-29 15:25:02.709 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:25:03.709 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:25:03.710 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-10, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:25:06.201 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-10, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:06.201 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-10, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:25:06.201 DEBUG 10 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:25:06.201 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-10, inFlight=0, closed=true] closing connection
2021-04-29 15:25:06.201 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-10, inFlight=0, closed=true] has already terminated
2021-04-29 15:25:06.201 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:06.202 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:25:06.203 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 2000 ms
2021-04-29 15:25:08.203 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:25:08.206 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-11, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:25:08.407 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-11, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:08.407 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-11, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:25:08.408 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-11, inFlight=0, closed=true] closing connection
2021-04-29 15:25:08.408 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:25:08.408 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-11, inFlight=0, closed=true] has already terminated
2021-04-29 15:25:08.408 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:08.409 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:25:08.410 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 4000 ms
2021-04-29 15:25:12.410 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:25:12.414 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-12, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:25:12.491 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-12, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:12.491 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-12, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:25:12.491 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-12, inFlight=0, closed=true] closing connection
2021-04-29 15:25:12.492 DEBUG 10 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:25:12.492 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-12, inFlight=0, closed=true] has already terminated
2021-04-29 15:25:12.492 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:12.493 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:25:12.494 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 8000 ms
2021-04-29 15:25:20.494 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:25:20.496 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-13, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:25:23.003 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-13, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:23.003 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-13, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:25:23.003 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-13, inFlight=0, closed=true] closing connection
2021-04-29 15:25:23.004 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:25:23.004 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-13, inFlight=0, closed=true] has already terminated
2021-04-29 15:25:23.004 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:25:23.005 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:25:23.006 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 16000 ms
2021-04-29 15:25:30.192 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:25:30.217 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:25:31.811 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:25:31.817 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:25:34.748 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:25:22.734Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (timeout while waiting for repair of inconsistent replica)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (timeout while waiting for repair of inconsistent replica)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (timeout while waiting for repair of inconsistent replica)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:25:39.006 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:25:39.008 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-14, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:25:44.602 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-14, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-04-29 15:25:44.602 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-14, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:25:44.602 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-14, inFlight=0, closed=true] closing connection
2021-04-29 15:25:44.603 DEBUG 10 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:25:44.603 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-14, inFlight=0, closed=true] has already terminated
2021-04-29 15:25:44.603 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-04-29 15:25:44.604 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 32000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:25:44.604 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 32000 ms
2021-04-29 15:26:01.819 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:26:01.821 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:26:12.423 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.226.88:9042, scheduling delivery
2021-04-29 15:26:12.423 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] received event DOWN
2021-04-29 15:26:13.424 DEBUG 10 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.226.88:9042 because it still has active connections
2021-04-29 15:26:16.605 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:26:16.606 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-15, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:18.243 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:26:21.894 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-15, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:21.894 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-15, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:26:21.895 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-15, inFlight=0, closed=true] closing connection
2021-04-29 15:26:21.895 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:26:21.895 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-15, inFlight=0, closed=true] has already terminated
2021-04-29 15:26:21.895 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:26:21.897 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 64000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:26:21.898 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 64000 ms
2021-04-29 15:26:23.072 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [735485153-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2357dc3e at consistency LOCAL_QUORUM
2021-04-29 15:26:23.073 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [735485153-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:26:30.272 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] because: [/10.242.226.88:9042] Heartbeat query timed out
2021-04-29 15:26:30.272 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preventing new connections for the next 1000 ms
2021-04-29 15:26:30.272 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-1, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:26:30.273 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=true] closing connection
2021-04-29 15:26:30.273 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-1, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:26:30.273 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] marking host DOWN
2021-04-29 15:26:30.274 DEBUG 10 --- [luster-worker-8] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:26:30.274 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] starting reconnection attempt
2021-04-29 15:26:31.274 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:26:31.276 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:31.431 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.64.133:9042, scheduling delivery
2021-04-29 15:26:31.431 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] received event DOWN
2021-04-29 15:26:32.431 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:26:34.197 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [615193766-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@513c41c3 at consistency null
2021-04-29 15:26:34.197 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [615193766-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:34.226 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [469302763-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4d89e836 at consistency null
2021-04-29 15:26:34.227 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [469302763-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:34.254 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [72764385-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@598f5bdd at consistency null
2021-04-29 15:26:34.254 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [72764385-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:34.281 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [344205200-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6d4d60d at consistency null
2021-04-29 15:26:34.281 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [344205200-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:34.308 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1756776330-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@35d5ad4d at consistency null
2021-04-29 15:26:34.308 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1756776330-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:34.336 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [889059538-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@379f2b99 at consistency null
2021-04-29 15:26:34.336 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [889059538-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:34.363 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [37926127-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@146dcf04 at consistency null
2021-04-29 15:26:34.363 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [37926127-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:34.416 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [936360848-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3429073a at consistency null
2021-04-29 15:26:34.416 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [936360848-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:34.523 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1839149300-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2c8e6b37 at consistency null
2021-04-29 15:26:34.523 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1839149300-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:34.626 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [914321149-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@62835edc at consistency null
2021-04-29 15:26:34.626 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [914321149-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:34.729 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [554520849-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@186ca867 at consistency null
2021-04-29 15:26:34.729 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [554520849-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:34.832 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1809087899-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@64807c87 at consistency null
2021-04-29 15:26:34.832 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1809087899-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:35.035 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2136533125-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3b8874f3 at consistency null
2021-04-29 15:26:35.035 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2136533125-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:35.239 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [840788245-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4385a8e0 at consistency null
2021-04-29 15:26:35.239 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [840788245-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:35.442 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2043884446-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3e570f67 at consistency null
2021-04-29 15:26:35.442 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2043884446-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:35.645 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [832807322-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5954286e at consistency null
2021-04-29 15:26:35.645 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [832807322-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:35.848 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [151485419-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2183e05b at consistency null
2021-04-29 15:26:35.848 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [151485419-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:36.051 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1351351839-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4faf9e23 at consistency null
2021-04-29 15:26:36.051 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1351351839-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:36.454 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [807696467-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@49058c86 at consistency null
2021-04-29 15:26:36.454 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [807696467-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:37.257 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [480751804-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@31eada90 at consistency null
2021-04-29 15:26:37.257 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [480751804-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:38.060 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [785209568-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@fd565ce at consistency null
2021-04-29 15:26:38.060 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [785209568-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:38.061 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:26:43.065 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [565780512-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3cb8ac91 at consistency null
2021-04-29 15:26:43.065 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [565780512-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:43.092 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [852239012-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@593c663c at consistency null
2021-04-29 15:26:43.092 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [852239012-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:43.120 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [323962385-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3e6509d1 at consistency null
2021-04-29 15:26:43.120 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [323962385-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:43.149 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1459689152-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1abae0c6 at consistency null
2021-04-29 15:26:43.149 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1459689152-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:43.176 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1062306848-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@631f1b24 at consistency null
2021-04-29 15:26:43.176 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1062306848-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:43.229 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1817921644-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@59a89cfd at consistency null
2021-04-29 15:26:43.229 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1817921644-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:43.282 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [88994872-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f952d98 at consistency null
2021-04-29 15:26:43.282 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [88994872-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:43.384 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1520784711-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2e4587c at consistency null
2021-04-29 15:26:43.385 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1520784711-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:43.488 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1776724663-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@19b9a53f at consistency null
2021-04-29 15:26:43.488 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1776724663-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:43.590 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1598592975-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@46b8d81 at consistency null
2021-04-29 15:26:43.591 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1598592975-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:43.701 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [902714410-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@62f49979 at consistency null
2021-04-29 15:26:43.701 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [902714410-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:43.904 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1169236153-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@42f30ae3 at consistency null
2021-04-29 15:26:43.904 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1169236153-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:44.107 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [425630122-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1637cfdf at consistency null
2021-04-29 15:26:44.107 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [425630122-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:44.510 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [36934561-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4e684f1d at consistency null
2021-04-29 15:26:44.510 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [36934561-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:45.313 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1167849673-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@89128f8 at consistency null
2021-04-29 15:26:45.313 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1167849673-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:46.116 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [157531179-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@52ef8f1b at consistency null
2021-04-29 15:26:46.116 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [157531179-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:46.117 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:26:50.772 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:26:50.773 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-2, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:26:50.773 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=true] closing connection
2021-04-29 15:26:50.773 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-2, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:26:50.773 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:26:50.773 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 2000 milliseconds
2021-04-29 15:26:50.773 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 2000 ms
2021-04-29 15:26:51.121 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1688074084-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7a0efbae at consistency null
2021-04-29 15:26:51.122 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1688074084-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:51.149 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2058215117-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@76125355 at consistency null
2021-04-29 15:26:51.149 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2058215117-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:51.217 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1625963745-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@77c57387 at consistency null
2021-04-29 15:26:51.217 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1625963745-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:51.270 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1962694195-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@597cad33 at consistency null
2021-04-29 15:26:51.270 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1962694195-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:51.418 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2144450847-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5422ee39 at consistency null
2021-04-29 15:26:51.418 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2144450847-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:51.522 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1805536158-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@30ce9713 at consistency null
2021-04-29 15:26:51.522 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1805536158-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:51.627 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1520594744-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6c4b83c6 at consistency null
2021-04-29 15:26:51.627 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1520594744-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:51.830 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1291450257-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5062be49 at consistency null
2021-04-29 15:26:51.830 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1291450257-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:52.233 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1049802320-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1372d15a at consistency null
2021-04-29 15:26:52.234 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1049802320-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:52.774 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:26:52.776 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-3, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:26:53.038 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [659151015-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5740ba28 at consistency null
2021-04-29 15:26:53.039 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [659151015-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:53.842 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1851504857-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@67a546b5 at consistency null
2021-04-29 15:26:53.843 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1851504857-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:54.645 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1830653948-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@22f02cfe at consistency null
2021-04-29 15:26:54.646 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1830653948-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:54.647 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:26:58.592 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-1, inFlight=0, closed=true] has already terminated
2021-04-29 15:26:59.654 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1175884857-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@270dc1fb at consistency null
2021-04-29 15:26:59.654 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1175884857-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:59.683 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [796127420-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@754ebec8 at consistency null
2021-04-29 15:26:59.683 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [796127420-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:59.736 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [475859195-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3893ce3a at consistency null
2021-04-29 15:26:59.737 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [475859195-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:59.840 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [498992867-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1b27820a at consistency null
2021-04-29 15:26:59.840 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [498992867-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:26:59.943 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1878785585-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@52ec9a8c at consistency null
2021-04-29 15:26:59.943 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1878785585-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:00.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1597838690-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5254c6e7 at consistency null
2021-04-29 15:27:00.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1597838690-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:00.549 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [735302830-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@74102089 at consistency null
2021-04-29 15:27:00.549 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [735302830-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:01.353 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1178031657-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5300cbd3 at consistency null
2021-04-29 15:27:01.353 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1178031657-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:01.435 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:27:01.437 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:27:02.957 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1988965032-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@658e03c5 at consistency null
2021-04-29 15:27:02.957 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1988965032-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:02.960 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:27:07.964 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1101836062-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1199826d at consistency null
2021-04-29 15:27:07.965 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1101836062-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:07.994 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1961846049-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6478ecbf at consistency null
2021-04-29 15:27:07.994 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1961846049-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:08.047 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [135652235-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3173edb0 at consistency null
2021-04-29 15:27:08.047 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [135652235-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:08.100 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [387094611-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@24765070 at consistency null
2021-04-29 15:27:08.101 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [387094611-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:08.204 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [862061040-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@79a12479 at consistency null
2021-04-29 15:27:08.204 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [862061040-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:08.238 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-3, inFlight=0, closed=false] because: Authentication error on host /10.242.226.88:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-04-29 15:27:08.238 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-3, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:27:08.239 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-3, inFlight=0, closed=true] closing connection
2021-04-29 15:27:08.239 DEBUG 10 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:27:08.240 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.226.88:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-04-29 15:27:08.240 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.226.88:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.226.88:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:27:08.241 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-3, inFlight=0, closed=true] has already terminated
2021-04-29 15:27:08.241 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 4000 ms
2021-04-29 15:27:08.407 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1009495248-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5a1f32e6 at consistency null
2021-04-29 15:27:08.407 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1009495248-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:08.610 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [453314917-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@74af4a78 at consistency null
2021-04-29 15:27:08.610 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [453314917-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:09.013 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [416729686-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@624c714d at consistency null
2021-04-29 15:27:09.013 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [416729686-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:09.817 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [999830845-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@123e0391 at consistency null
2021-04-29 15:27:09.817 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [999830845-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:11.420 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1513374642-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@31158b32 at consistency null
2021-04-29 15:27:11.421 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1513374642-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:27:11.422 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:27:12.242 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:27:12.244 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:27:15.566 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-4, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 15:27:15.566 DEBUG 10 --- [-reconnection-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.226.88:9042
2021-04-29 15:27:15.618 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Successful reconnection to /10.242.226.88:9042, setting host UP
2021-04-29 15:27:15.618 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] marking host UP
2021-04-29 15:27:15.618 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2021-04-29 15:27:15.619 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.226.88:9042
2021-04-29 15:27:15.639 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 0 new connections, total = 1
2021-04-29 15:27:15.639 DEBUG 10 --- [-reconnection-1] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.226.88:9042 (1 connections needed, 1 successfully opened)
2021-04-29 15:27:15.639 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Session : Added connection pool for /10.242.226.88:9042
2021-04-29 15:27:15.640 DEBUG 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2021-04-29 15:27:21.477 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:27:25.898 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:27:25.900 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-16, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:27:28.593 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-2, inFlight=0, closed=true] has already terminated
2021-04-29 15:27:34.800 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-16, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:27:34.800 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-16, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:27:34.800 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-16, inFlight=0, closed=true] closing connection
2021-04-29 15:27:34.801 DEBUG 10 --- [uster-worker-10] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:27:34.801 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-16, inFlight=0, closed=true] has already terminated
2021-04-29 15:27:34.801 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:27:34.801 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 128000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:27:34.802 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 128000 ms
2021-04-29 15:27:38.572 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1197720741-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7f461a5c at consistency LOCAL_QUORUM
2021-04-29 15:27:38.573 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1197720741-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:27:38.576 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:27:43.637 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=1, closed=false] Response received on stream 3712 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:27:45.632 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:27:45.640 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:27:55.673 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1026044073-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@175a69e3 at consistency LOCAL_QUORUM
2021-04-29 15:27:55.674 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1026044073-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:27:55.720 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:28:03.734 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=1, closed=false] Response received on stream 3776 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:28:03.737 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1174003053-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@58d41d7a at consistency null
2021-04-29 15:28:03.738 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1174003053-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:03.837 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1705871045-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ed0a12d at consistency null
2021-04-29 15:28:03.837 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1705871045-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:14.671 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1009922105-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7b659cc1 at consistency null
2021-04-29 15:28:14.671 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1009922105-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:14.676 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:28:15.661 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:28:15.718 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:28:22.865 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1080287854-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5f37a975 at consistency null
2021-04-29 15:28:22.865 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1080287854-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:22.951 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1274699194-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27f05024 at consistency null
2021-04-29 15:28:22.951 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1274699194-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:22.981 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1122525614-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f67ebe2 at consistency null
2021-04-29 15:28:22.982 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1122525614-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:23.092 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1878405682-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3e20335a at consistency null
2021-04-29 15:28:23.092 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1878405682-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:23.222 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [811195696-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5ce08d84 at consistency null
2021-04-29 15:28:23.222 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [811195696-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:23.347 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [701976844-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@41b1d131 at consistency null
2021-04-29 15:28:23.347 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [701976844-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:23.463 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [682860681-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@41891a1e at consistency null
2021-04-29 15:28:23.463 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [682860681-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:29.062 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:28:37.969 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1980395535-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2c22543e at consistency null
2021-04-29 15:28:37.969 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1980395535-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:38.052 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [147100579-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2658756e at consistency null
2021-04-29 15:28:38.052 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [147100579-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:45.719 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:28:45.722 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:28:49.739 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:28:54.747 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [453573766-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@69af00cd at consistency null
2021-04-29 15:28:54.747 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [453573766-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:56.017 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [780841094-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@60ffbe0c at consistency null
2021-04-29 15:28:56.017 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [780841094-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:56.141 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [186984272-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7cb3997e at consistency null
2021-04-29 15:28:56.141 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [186984272-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:28:57.017 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [659612700-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@19257083 at consistency null
2021-04-29 15:28:57.017 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [659612700-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:05.186 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:29:10.238 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [2069942460-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7b7656ef at consistency null
2021-04-29 15:29:10.239 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [2069942460-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:10.317 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [9785814-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@89da202 at consistency null
2021-04-29 15:29:10.317 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [9785814-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:10.386 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [573110579-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@150f62c3 at consistency null
2021-04-29 15:29:10.386 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [573110579-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:10.534 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [41453934-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@19e824f5 at consistency null
2021-04-29 15:29:10.534 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [41453934-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:10.637 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [2145410221-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3cbc369c at consistency null
2021-04-29 15:29:10.637 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [2145410221-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:10.749 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1439803750-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2810691 at consistency null
2021-04-29 15:29:10.749 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1439803750-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:10.849 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [810886030-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4b89e900 at consistency null
2021-04-29 15:29:10.850 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [810886030-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:10.954 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1990258451-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@75177175 at consistency null
2021-04-29 15:29:10.954 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1990258451-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:11.217 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [198754398-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4704b63c at consistency null
2021-04-29 15:29:11.217 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [198754398-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:11.717 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1402655450-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@22ec916c at consistency null
2021-04-29 15:29:11.717 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1402655450-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:12.141 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1246413428-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4c9be688 at consistency null
2021-04-29 15:29:12.141 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1246413428-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:12.568 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [996373593-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2c9bab7 at consistency null
2021-04-29 15:29:12.568 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [996373593-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:15.750 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:29:15.752 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:29:23.594 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:29:28.606 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1995741531-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@609e5984 at consistency null
2021-04-29 15:29:28.607 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1995741531-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:40.673 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1995741531-0] Doing retry 2 for query com.datastax.driver.core.BoundStatement@609e5984 at consistency LOCAL_QUORUM
2021-04-29 15:29:40.673 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1995741531-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:29:40.677 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.226.88:9042 (com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response), cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.226.88:9042 (com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response), cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:962)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1575)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:29:42.803 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:29:42.806 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-17, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:29:44.339 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=0, closed=false] Response received on stream 5632 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR UNAVAILABLE: Cannot achieve consistency level LOCAL_QUORUM
2021-04-29 15:29:45.752 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:29:45.755 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:29:46.152 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1937611101-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@40317d90 at consistency null
2021-04-29 15:29:46.153 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1937611101-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:46.182 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1874377764-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@263fd30a at consistency null
2021-04-29 15:29:46.182 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1874377764-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:29:54.873 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-17, inFlight=0, closed=false] because: [/10.242.64.133:9042] Operation timed out
2021-04-29 15:29:54.873 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-17, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:29:54.874 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-17, inFlight=0, closed=true] closing connection
2021-04-29 15:29:54.874 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.64.133:9042-17, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:29:54.874 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Operation timed out), scheduling retry in 256000 milliseconds
2021-04-29 15:29:54.874 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:29:54.874 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 256000 ms
2021-04-29 15:29:58.273 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1874377764-0] Doing retry 2 for query com.datastax.driver.core.BoundStatement@263fd30a at consistency LOCAL_QUORUM
2021-04-29 15:29:58.273 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1874377764-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:29:58.274 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.226.88:9042 (com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response), cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.226.88:9042 (com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response), cassandra/10.242.76.214:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onTimeout(RequestHandler.java:962)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1575)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2021-04-29 15:30:05.156 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=1, closed=false] Response received on stream 5760 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR UNAVAILABLE: Cannot achieve consistency level LOCAL_QUORUM
2021-04-29 15:30:05.156 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1331285046-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@26d1906d at consistency null
2021-04-29 15:30:05.156 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1331285046-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:05.242 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [498449095-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3376c161 at consistency null
2021-04-29 15:30:05.242 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [498449095-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:05.354 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [35483485-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1e9d83d1 at consistency null
2021-04-29 15:30:05.354 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [35483485-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:05.533 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [686733990-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@34653a97 at consistency null
2021-04-29 15:30:05.533 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [686733990-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:06.672 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [693631985-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@319d88b3 at consistency null
2021-04-29 15:30:06.672 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [693631985-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:06.941 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [419696542-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@39d60ccc at consistency null
2021-04-29 15:30:06.941 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [419696542-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:07.145 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1879768164-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3583dee3 at consistency null
2021-04-29 15:30:07.145 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1879768164-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:07.150 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:30:12.217 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [762073929-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7ad0c6e6 at consistency null
2021-04-29 15:30:12.217 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [762073929-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:12.285 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1005763942-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@568bb95d at consistency null
2021-04-29 15:30:12.285 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1005763942-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:12.417 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [36908409-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6890e241 at consistency null
2021-04-29 15:30:12.417 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [36908409-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:12.527 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [628955271-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@30efcbda at consistency null
2021-04-29 15:30:12.527 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [628955271-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:12.745 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1782899066-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@b0e7b2f at consistency null
2021-04-29 15:30:12.745 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1782899066-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:13.149 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1148418265-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@237a6ee at consistency null
2021-04-29 15:30:13.150 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1148418265-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:13.553 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1605422539-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@67ab6d84 at consistency null
2021-04-29 15:30:13.553 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1605422539-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:14.023 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [306466714-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@8c609da at consistency null
2021-04-29 15:30:14.023 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [306466714-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:14.838 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1598432153-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@757e6b67 at consistency null
2021-04-29 15:30:14.838 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1598432153-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:15.770 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:30:15.817 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:30:23.333 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [2899224-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7e3465c4 at consistency null
2021-04-29 15:30:23.333 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [2899224-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:23.336 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:30:28.340 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1504409155-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@46b9b203 at consistency null
2021-04-29 15:30:28.340 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1504409155-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:28.597 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-17, inFlight=0, closed=true] has already terminated
2021-04-29 15:30:33.845 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:30:38.853 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1763957363-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5e6e0a49 at consistency null
2021-04-29 15:30:38.853 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1763957363-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:45.823 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:30:45.826 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:30:50.447 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:30:55.544 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [127366693-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@69bae2e at consistency null
2021-04-29 15:30:55.544 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [127366693-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:30:55.633 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1714573106-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@39a468c5 at consistency null
2021-04-29 15:30:55.633 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1714573106-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:31:03.143 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1680422105-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f8709c5 at consistency null
2021-04-29 15:31:03.143 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1680422105-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:31:03.146 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:31:11.745 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [321817197-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@62c041b4 at consistency null
2021-04-29 15:31:11.745 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [321817197-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:31:11.842 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [800383091-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3971691c at consistency null
2021-04-29 15:31:11.842 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [800383091-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:31:11.917 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1527476584-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@62958b4d at consistency null
2021-04-29 15:31:11.917 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1527476584-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:31:12.037 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1990793516-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5aa5d61c at consistency null
2021-04-29 15:31:12.038 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1990793516-0] Error querying cassandra/10.242.76.214:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:31:12.042 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:26:27.602Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.exceptions.UnavailableException.copy(UnavailableException.java:133)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:159)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:79)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:31:13.299 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.64.133:9042, scheduling delivery
2021-04-29 15:31:13.299 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] received event UP
2021-04-29 15:31:14.301 DEBUG 10 --- [uster-worker-12] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.64.133:9042
2021-04-29 15:31:14.319 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] marking host UP
2021-04-29 15:31:14.319 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2021-04-29 15:31:14.319 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.64.133:9042
2021-04-29 15:31:14.319 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:31:14.322 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-18, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:31:15.114 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-18, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:31:15.114 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-18, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:31:15.114 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-18, inFlight=0, closed=true] closing connection
2021-04-29 15:31:15.115 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-18, inFlight=0, closed=true] has already terminated
2021-04-29 15:31:15.115 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:31:15.117 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-19, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:31:15.189 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-19, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:31:15.189 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-19, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:31:15.189 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-19, inFlight=0, closed=true] closing connection
2021-04-29 15:31:15.190 WARN 10 --- [er-nio-worker-2] com.datastax.driver.core.Session : Error creating pool to /10.242.64.133:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:31:15.191 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-19, inFlight=0, closed=true] has already terminated
2021-04-29 15:31:15.191 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Connection pool cannot be created, not marking /10.242.64.133:9042 UP
2021-04-29 15:31:15.191 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] marking host DOWN
2021-04-29 15:31:15.192 DEBUG 10 --- [uster-worker-13] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:31:15.192 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] starting reconnection attempt
2021-04-29 15:31:15.192 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:31:16.192 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:31:16.194 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-20, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:31:16.502 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-20, inFlight=0, closed=false] because: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:31:16.503 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-20, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:31:16.503 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:31:16.503 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-20, inFlight=0, closed=true] closing connection
2021-04-29 15:31:16.504 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-20, inFlight=0, closed=true] has already terminated
2021-04-29 15:31:16.504 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:31:16.504 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.133:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.133:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:31:16.505 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 2000 ms
2021-04-29 15:31:18.335 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [288594038-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6bb5306 at consistency null
2021-04-29 15:31:18.336 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [288594038-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:31:18.506 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:31:18.507 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-21, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:31:18.544 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.226.88:9042, scheduling delivery
2021-04-29 15:31:18.544 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] received event UP
2021-04-29 15:31:19.544 DEBUG 10 --- [uster-worker-12] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.226.88:9042
2021-04-29 15:31:19.894 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-21, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 15:31:19.895 DEBUG 10 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.64.133:9042
2021-04-29 15:31:19.897 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Successful reconnection to /10.242.64.133:9042, setting host UP
2021-04-29 15:31:19.897 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] marking host UP
2021-04-29 15:31:19.897 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2021-04-29 15:31:19.897 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.64.133:9042
2021-04-29 15:31:19.993 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 0 new connections, total = 1
2021-04-29 15:31:19.993 DEBUG 10 --- [-reconnection-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.64.133:9042 (1 connections needed, 1 successfully opened)
2021-04-29 15:31:19.994 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Session : Added connection pool for /10.242.64.133:9042
2021-04-29 15:31:19.994 DEBUG 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2021-04-29 15:31:24.993 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-21, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:31:24.993 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-21, inFlight=0, closed=false] because: [/10.242.64.133:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2021-04-29 15:31:24.993 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preventing new connections for the next 1000 ms
2021-04-29 15:31:24.993 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-21, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:31:24.993 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-21, inFlight=0, closed=true] closing connection
2021-04-29 15:31:24.993 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] marking host DOWN
2021-04-29 15:31:24.994 DEBUG 10 --- [uster-worker-13] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:31:24.994 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] starting reconnection attempt
2021-04-29 15:31:24.998 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.64.133:9042, scheduling delivery
2021-04-29 15:31:24.999 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] received event DOWN
2021-04-29 15:31:25.994 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:31:25.997 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-22, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (Connection refused: /10.242.64.133:9042)
2021-04-29 15:31:25.997 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-22, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 15:31:25.997 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-22, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:31:25.997 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-22, inFlight=0, closed=true] closing connection
2021-04-29 15:31:25.997 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:31:25.998 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 2000 milliseconds
2021-04-29 15:31:25.998 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 2000 ms
2021-04-29 15:31:25.999 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:31:27.998 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:31:28.000 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-23, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (Connection refused: /10.242.64.133:9042)
2021-04-29 15:31:28.000 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-23, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 15:31:28.000 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-23, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:31:28.000 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-23, inFlight=0, closed=true] closing connection
2021-04-29 15:31:28.000 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:31:28.001 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 4000 milliseconds
2021-04-29 15:31:28.001 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 4000 ms
2021-04-29 15:31:32.001 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:31:32.003 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-24, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (Connection refused: /10.242.64.133:9042)
2021-04-29 15:31:32.003 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-24, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 15:31:32.003 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-24, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:31:32.003 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-24, inFlight=0, closed=true] closing connection
2021-04-29 15:31:32.003 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:31:32.003 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 8000 milliseconds
2021-04-29 15:31:32.004 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 8000 ms
2021-04-29 15:31:40.004 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:31:40.005 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-25, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (Connection refused: /10.242.64.133:9042)
2021-04-29 15:31:40.006 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-25, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 15:31:40.006 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-25, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:31:40.006 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-25, inFlight=0, closed=true] closing connection
2021-04-29 15:31:40.006 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:31:40.007 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 16000 milliseconds
2021-04-29 15:31:40.007 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 16000 ms
2021-04-29 15:31:55.008 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:31:55.010 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:31:56.007 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:32:01.016 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-26, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (connection timed out: /10.242.64.133:9042)
2021-04-29 15:32:01.017 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-26, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 15:32:01.017 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-26, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:32:01.017 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-26, inFlight=0, closed=true] closing connection
2021-04-29 15:32:01.017 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:32:01.018 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 32000 milliseconds
2021-04-29 15:32:01.018 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 32000 ms
2021-04-29 15:32:18.751 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:32:18.753 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:32:25.039 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:32:25.044 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:32:33.018 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:32:38.027 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-27, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (connection timed out: /10.242.64.133:9042)
2021-04-29 15:32:38.027 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-27, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 15:32:38.028 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] Connection[/10.242.64.133:9042-27, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:32:38.029 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-27, inFlight=0, closed=true] closing connection
2021-04-29 15:32:38.029 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.133:9042
2021-04-29 15:32:38.029 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 64000 milliseconds
2021-04-29 15:32:38.029 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 64000 ms
2021-04-29 15:32:55.055 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:32:55.057 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:32:58.229 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT NEW_NODE /10.242.64.158:9042, scheduling delivery
2021-04-29 15:32:58.229 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] received event NEW_NODE
2021-04-29 15:32:58.230 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.64.158:9042, scheduling delivery
2021-04-29 15:32:58.230 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] received event UP
2021-04-29 15:32:59.232 DEBUG 10 --- [uster-worker-15] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.64.158:9042
2021-04-29 15:32:59.240 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] adding host
2021-04-29 15:32:59.240 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.64.158:9042
2021-04-29 15:32:59.240 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:32:59.243 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:32:59.330 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.158:9042-1, inFlight=0, closed=false] because: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:32:59.330 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preventing new connections for the next 1000 ms
2021-04-29 15:32:59.330 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-1, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:32:59.330 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-1, inFlight=0, closed=true] closing connection
2021-04-29 15:32:59.331 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-1, inFlight=0, closed=true] has already terminated
2021-04-29 15:32:59.331 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:32:59.333 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:32:59.403 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.158:9042-2, inFlight=0, closed=false] because: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:32:59.403 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preventing new connections for the next 1000 ms
2021-04-29 15:32:59.403 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-2, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:32:59.403 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-2, inFlight=0, closed=true] closing connection
2021-04-29 15:32:59.405 WARN 10 --- [er-nio-worker-2] com.datastax.driver.core.Session : Error creating pool to /10.242.64.158:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:32:59.406 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-2, inFlight=0, closed=true] has already terminated
2021-04-29 15:32:59.407 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Cluster : Connection pool cannot be created, not marking /10.242.64.158:9042 UP
2021-04-29 15:32:59.407 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] marking host DOWN
2021-04-29 15:32:59.407 DEBUG 10 --- [uster-worker-14] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:32:59.407 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] starting reconnection attempt
2021-04-29 15:32:59.407 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.158:9042
2021-04-29 15:33:00.407 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:33:00.409 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-3, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:33:00.412 DEBUG 10 --- [uster-worker-14] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2021-04-29 15:33:00.415 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.158:9042-3, inFlight=0, closed=false] because: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:33:00.415 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-3, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:33:00.415 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-3, inFlight=0, closed=true] closing connection
2021-04-29 15:33:00.416 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-3, inFlight=0, closed=true] has already terminated
2021-04-29 15:33:00.416 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:33:00.416 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.158:9042
2021-04-29 15:33:00.416 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.158:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:33:00.418 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] next reconnection attempt in 2000 ms
2021-04-29 15:33:00.420 INFO 10 --- [uster-worker-14] com.datastax.driver.core.Cluster : Cassandra host /10.242.64.133:9042 removed
2021-04-29 15:33:00.422 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] removing host
2021-04-29 15:33:00.423 DEBUG 10 --- [uster-worker-14] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:33:00.428 DEBUG 10 --- [uster-worker-14] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 5 milliseconds
2021-04-29 15:33:02.418 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:33:02.420 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-4, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:33:02.425 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.158:9042-4, inFlight=0, closed=false] because: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:33:02.425 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-4, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:33:02.425 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-4, inFlight=0, closed=true] closing connection
2021-04-29 15:33:02.425 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.158:9042
2021-04-29 15:33:02.426 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-4, inFlight=0, closed=true] has already terminated
2021-04-29 15:33:02.426 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:33:02.426 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.158:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:33:02.427 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] next reconnection attempt in 4000 ms
2021-04-29 15:33:06.427 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:33:06.429 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-5, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:33:06.437 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.158:9042-5, inFlight=0, closed=false] because: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:33:06.437 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-5, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:33:06.437 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-5, inFlight=0, closed=true] closing connection
2021-04-29 15:33:06.437 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.158:9042
2021-04-29 15:33:06.438 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-5, inFlight=0, closed=true] has already terminated
2021-04-29 15:33:06.438 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:33:06.438 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.158:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:33:06.440 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] next reconnection attempt in 8000 ms
2021-04-29 15:33:14.034 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.226.88:9042, scheduling delivery
2021-04-29 15:33:14.034 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] received event DOWN
2021-04-29 15:33:14.440 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:33:14.442 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-6, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:33:14.492 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.158:9042-6, inFlight=0, closed=false] because: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:33:14.493 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-6, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:33:14.493 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-6, inFlight=0, closed=true] closing connection
2021-04-29 15:33:14.493 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.158:9042
2021-04-29 15:33:14.494 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-6, inFlight=0, closed=true] has already terminated
2021-04-29 15:33:14.494 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:33:14.495 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.158:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:33:14.496 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] next reconnection attempt in 16000 ms
2021-04-29 15:33:15.034 DEBUG 10 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.226.88:9042 because it still has active connections
2021-04-29 15:33:30.496 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:33:30.501 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-7, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:33:30.507 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.158:9042-7, inFlight=0, closed=false] because: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:33:30.507 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-7, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:33:30.507 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-7, inFlight=0, closed=true] closing connection
2021-04-29 15:33:30.508 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.158:9042
2021-04-29 15:33:30.508 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-7, inFlight=0, closed=true] has already terminated
2021-04-29 15:33:30.508 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:33:30.510 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.158:9042, scheduling retry in 32000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:33:30.512 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] next reconnection attempt in 32000 ms
2021-04-29 15:33:36.372 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1246024501-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@638fb314 at consistency LOCAL_QUORUM
2021-04-29 15:33:36.373 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1246024501-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:33:39.275 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:33:42.030 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:33:44.047 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:33:44.048 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:33:44.173 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=1, closed=false] heartbeat query succeeded
2021-04-29 15:33:45.385 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=0, closed=false] Response received on stream 8320 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:33:47.033 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-28, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (connection timed out: /10.242.64.133:9042)
2021-04-29 15:33:47.034 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-28, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 15:33:47.034 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-28, inFlight=0, closed=true] closing connection
2021-04-29 15:33:47.035 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 128000 milliseconds
2021-04-29 15:33:47.035 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 128000 ms
2021-04-29 15:34:02.512 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:34:02.514 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-8, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:34:02.517 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.158:9042-8, inFlight=0, closed=false] because: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:34:02.517 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-8, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:34:02.517 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-8, inFlight=0, closed=true] closing connection
2021-04-29 15:34:02.518 DEBUG 10 --- [uster-worker-16] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.158:9042
2021-04-29 15:34:02.518 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-8, inFlight=0, closed=true] has already terminated
2021-04-29 15:34:02.518 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:34:02.519 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.158:9042, scheduling retry in 64000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:34:02.521 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] next reconnection attempt in 64000 ms
2021-04-29 15:34:14.069 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:34:14.071 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:34:20.434 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:34:20.435 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:34:44.101 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:34:44.104 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:35:02.873 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1432144811-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27dedbf7 at consistency LOCAL_QUORUM
2021-04-29 15:35:02.874 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1432144811-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:35:06.521 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:35:06.524 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-9, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:35:06.529 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.158:9042-9, inFlight=0, closed=false] because: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:35:06.529 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-9, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:35:06.531 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-9, inFlight=0, closed=true] closing connection
2021-04-29 15:35:06.531 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.158:9042
2021-04-29 15:35:06.532 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-9, inFlight=0, closed=true] has already terminated
2021-04-29 15:35:06.532 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:35:06.533 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.158:9042, scheduling retry in 128000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:35:06.534 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] next reconnection attempt in 128000 ms
2021-04-29 15:35:10.787 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:35:14.125 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:35:14.127 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:35:19.972 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1405867019-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3fba4e04 at consistency LOCAL_QUORUM
2021-04-29 15:35:19.973 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1405867019-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:35:22.872 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-4, inFlight=0, closed=false] because: [/10.242.226.88:9042] Heartbeat query timed out
2021-04-29 15:35:22.872 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preventing new connections for the next 1000 ms
2021-04-29 15:35:22.872 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-4, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:35:22.872 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=0, closed=true] closing connection
2021-04-29 15:35:22.873 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-4, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:35:22.873 DEBUG 10 --- [uster-worker-18] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] marking host DOWN
2021-04-29 15:35:22.873 DEBUG 10 --- [uster-worker-18] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:35:22.874 DEBUG 10 --- [uster-worker-18] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] starting reconnection attempt
2021-04-29 15:35:23.874 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:35:23.875 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-5, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:35:35.972 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-5, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:35:35.972 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-5, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:35:35.972 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-5, inFlight=0, closed=true] closing connection
2021-04-29 15:35:35.972 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-5, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:35:35.973 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:35:35.973 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 2000 milliseconds
2021-04-29 15:35:35.973 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 2000 ms
2021-04-29 15:35:37.973 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:35:37.975 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-6, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:35:44.128 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:35:44.129 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:35:50.073 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-6, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:35:50.073 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-6, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:35:50.073 DEBUG 10 --- [uster-worker-18] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:35:50.073 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-6, inFlight=0, closed=true] closing connection
2021-04-29 15:35:50.074 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-6, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:35:50.074 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 4000 milliseconds
2021-04-29 15:35:50.074 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 4000 ms
2021-04-29 15:35:54.074 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:35:54.078 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-7, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:35:55.035 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 2
2021-04-29 15:35:58.602 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-4, inFlight=0, closed=true] has already terminated
2021-04-29 15:36:00.042 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-29, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (connection timed out: /10.242.64.133:9042)
2021-04-29 15:36:00.043 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-29, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 15:36:00.043 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-29, inFlight=0, closed=true] closing connection
2021-04-29 15:36:00.044 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 256000 milliseconds
2021-04-29 15:36:00.044 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 256000 ms
2021-04-29 15:36:08.372 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-7, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:36:08.372 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-7, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:36:08.373 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-7, inFlight=0, closed=true] closing connection
2021-04-29 15:36:08.373 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-7, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:36:08.373 DEBUG 10 --- [uster-worker-19] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:36:08.374 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 8000 milliseconds
2021-04-29 15:36:08.374 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 8000 ms
2021-04-29 15:36:13.603 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-5, inFlight=0, closed=true] has already terminated
2021-04-29 15:36:14.147 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:36:14.148 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:36:16.374 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:36:16.376 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-8, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:36:28.603 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-6, inFlight=0, closed=true] has already terminated
2021-04-29 15:36:29.921 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-8, inFlight=0, closed=false] because: Authentication error on host /10.242.226.88:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-04-29 15:36:29.921 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-8, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:36:29.921 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-8, inFlight=0, closed=true] closing connection
2021-04-29 15:36:29.921 DEBUG 10 --- [uster-worker-20] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:36:29.922 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-8, inFlight=0, closed=true] has already terminated
2021-04-29 15:36:29.922 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.226.88:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-04-29 15:36:29.924 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.226.88:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.226.88:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:36:29.926 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 16000 ms
2021-04-29 15:36:43.603 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-7, inFlight=0, closed=true] has already terminated
2021-04-29 15:36:44.161 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:36:44.163 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:36:45.926 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:36:45.928 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-9, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:36:57.973 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-9, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:36:57.973 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-9, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:36:57.973 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-9, inFlight=0, closed=true] closing connection
2021-04-29 15:36:57.973 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-9, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:36:57.973 DEBUG 10 --- [uster-worker-21] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:36:57.974 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 32000 milliseconds
2021-04-29 15:36:57.974 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 32000 ms
2021-04-29 15:37:14.191 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:37:14.194 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:37:14.535 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:37:14.537 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-10, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:37:14.541 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.158:9042-10, inFlight=0, closed=false] because: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:37:14.541 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-10, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:37:14.542 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-10, inFlight=0, closed=true] closing connection
2021-04-29 15:37:14.543 DEBUG 10 --- [uster-worker-22] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.158:9042
2021-04-29 15:37:14.543 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-10, inFlight=0, closed=true] has already terminated
2021-04-29 15:37:14.543 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:37:14.544 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.158:9042, scheduling retry in 256000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:37:14.545 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] next reconnection attempt in 256000 ms
2021-04-29 15:37:28.604 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-9, inFlight=0, closed=true] has already terminated
2021-04-29 15:37:29.974 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:37:29.976 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-10, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:37:42.072 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-10, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:37:42.073 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-10, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:37:42.073 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-10, inFlight=0, closed=true] closing connection
2021-04-29 15:37:42.073 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-10, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:37:42.073 DEBUG 10 --- [uster-worker-23] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:37:42.073 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 64000 milliseconds
2021-04-29 15:37:42.074 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 64000 ms
2021-04-29 15:37:44.218 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:37:44.220 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:38:13.605 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-10, inFlight=0, closed=true] has already terminated
2021-04-29 15:38:14.247 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:38:14.248 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:38:44.274 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:38:44.276 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:38:46.074 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:38:46.076 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:38:48.244 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 15:38:48.244 DEBUG 10 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.226.88:9042
2021-04-29 15:38:48.248 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Successful reconnection to /10.242.226.88:9042, setting host UP
2021-04-29 15:38:48.249 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] marking host UP
2021-04-29 15:38:48.249 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2021-04-29 15:38:48.249 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.226.88:9042
2021-04-29 15:39:00.274 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Unexpected error while preparing queries on new/newly up host
java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Operation timed out
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at com.datastax.driver.core.Cluster$Manager.prepareAllQueries(Cluster.java:2415)
at com.datastax.driver.core.Cluster$Manager.onUp(Cluster.java:1880)
at com.datastax.driver.core.Cluster$Manager.access$1000(Cluster.java:1390)
at com.datastax.driver.core.Cluster$Manager$6.onReconnection(Cluster.java:2046)
at com.datastax.driver.core.AbstractReconnectionHandler.run(AbstractReconnectionHandler.java:158)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1496)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1575)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
... 2 common frames omitted
2021-04-29 15:39:00.274 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Unexpected error while preparing queries on new/newly up host
java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Operation timed out
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435)
at com.datastax.driver.core.Cluster$Manager.prepareAllQueries(Cluster.java:2415)
at com.datastax.driver.core.Cluster$Manager.onUp(Cluster.java:1880)
at com.datastax.driver.core.Cluster$Manager.access$1000(Cluster.java:1390)
at com.datastax.driver.core.Cluster$Manager$6.onReconnection(Cluster.java:2046)
at com.datastax.driver.core.AbstractReconnectionHandler.run(AbstractReconnectionHandler.java:158)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1496)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1575)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
... 2 common frames omitted
2021-04-29 15:39:00.275 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 0 new connections, total = 1
2021-04-29 15:39:00.275 DEBUG 10 --- [-reconnection-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.226.88:9042 (1 connections needed, 1 successfully opened)
2021-04-29 15:39:00.275 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Session : Added connection pool for /10.242.226.88:9042
2021-04-29 15:39:00.275 DEBUG 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2021-04-29 15:39:11.136 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Response received on stream 3584 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is RESULT PREPARED 0x6e914c66a7dffa207a80461a2a6f52de [keystart (bigint)][keyend (bigint)][slicestart (blob)][sliceend (blob)] (resultMetadata=[key (blob)][column1 (blob)][value (blob)][writetime (bigint)][ttl (int)])
2021-04-29 15:39:11.136 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Response received on stream 2816 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is RESULT PREPARED 0x60370b096ee9ad5c3a8a463cfff4651b [key (blob)][column1 (blob)][value (blob)][timestamp (bigint)] (resultMetadata=[0 columns])
2021-04-29 15:39:18.251 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:39:18.252 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:39:48.255 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:39:48.257 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:40:16.044 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 3
2021-04-29 15:40:18.263 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:40:18.267 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:40:21.050 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-30, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (connection timed out: /10.242.64.133:9042)
2021-04-29 15:40:21.051 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-30, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 15:40:21.051 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-30, inFlight=0, closed=true] closing connection
2021-04-29 15:40:21.052 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 512000 milliseconds
2021-04-29 15:40:21.053 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 512000 ms
2021-04-29 15:40:48.267 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:40:48.270 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:41:01.773 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1465172453-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@625636ba at consistency LOCAL_QUORUM
2021-04-29 15:41:01.773 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1465172453-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:41:14.756 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:41:18.271 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:41:18.273 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:41:22.689 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=1, closed=false] heartbeat query succeeded
2021-04-29 15:41:23.872 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1724191229-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@88ec11c at consistency LOCAL_QUORUM
2021-04-29 15:41:23.872 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1724191229-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:41:30.545 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:41:30.548 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-11, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:41:30.552 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.158:9042-11, inFlight=0, closed=false] because: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:41:30.552 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-11, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:41:30.553 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-11, inFlight=0, closed=true] closing connection
2021-04-29 15:41:30.553 DEBUG 10 --- [uster-worker-24] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.64.158:9042
2021-04-29 15:41:30.553 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-11, inFlight=0, closed=true] has already terminated
2021-04-29 15:41:30.553 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2021-04-29 15:41:30.556 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.64.158:9042, scheduling retry in 512000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.64.158:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:41:30.558 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] next reconnection attempt in 512000 ms
2021-04-29 15:41:36.132 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Response received on stream 4288 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 0 responses.
2021-04-29 15:41:36.133 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Response received on stream 4352 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 0 responses.
2021-04-29 15:41:48.275 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:41:48.278 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:41:55.972 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [510426644-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2db72d79 at consistency LOCAL_QUORUM
2021-04-29 15:41:55.973 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [510426644-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:42:06.133 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:42:17.734 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=1, closed=false] heartbeat query succeeded
2021-04-29 15:42:18.172 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [989822739-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5df73089 at consistency LOCAL_QUORUM
2021-04-29 15:42:18.172 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [989822739-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:42:18.279 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:42:18.281 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:42:20.400 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Response received on stream 4544 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ROWS [4 columns]
---
2021-04-29 15:42:20.401 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Response received on stream 4480 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ROWS [4 columns]
---
2021-04-29 15:42:22.138 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.226.88:9042, scheduling delivery
2021-04-29 15:42:22.138 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] received event UP
2021-04-29 15:42:23.139 DEBUG 10 --- [uster-worker-25] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.226.88:9042
2021-04-29 15:42:36.624 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.226.88:9042, scheduling delivery
2021-04-29 15:42:36.624 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] received event DOWN
2021-04-29 15:42:37.624 DEBUG 10 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.226.88:9042 because it still has active connections
2021-04-29 15:42:40.373 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1364738083-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ec73e6b at consistency LOCAL_QUORUM
2021-04-29 15:42:40.373 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1364738083-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:42:50.403 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=1, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:42:56.132 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=1, closed=false] heartbeat query succeeded
2021-04-29 15:42:57.472 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [505610527-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@703f888e at consistency LOCAL_QUORUM
2021-04-29 15:42:57.472 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [505610527-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:42:58.674 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Response received on stream 4736 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:42:58.674 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Response received on stream 4672 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:43:06.627 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:43:06.631 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:43:19.673 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [990055514-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@64f7af15 at consistency LOCAL_QUORUM
2021-04-29 15:43:19.673 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [990055514-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:43:28.683 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:43:35.797 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=1, closed=false] heartbeat query succeeded
2021-04-29 15:43:36.632 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:43:36.633 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:43:41.972 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [786750894-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@60b87a at consistency LOCAL_QUORUM
2021-04-29 15:43:41.972 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [786750894-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:43:54.040 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Response received on stream 4992 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_TIMEOUT: Operation timed out - received only 1 responses.
2021-04-29 15:43:58.149 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [492406394-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6ec8837c at consistency null
2021-04-29 15:43:58.149 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [492406394-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:44:06.641 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:44:06.643 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:44:20.273 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1314253744-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@37e3ea7b at consistency LOCAL_QUORUM
2021-04-29 15:44:20.273 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [1314253744-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:44:20.505 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Response received on stream 4864 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR READ_FAILURE: Operation failed - received 1 responses and 1 failures
2021-04-29 15:44:20.537 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] Response received on stream 5120 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR UNAVAILABLE: Cannot achieve consistency level LOCAL_QUORUM
2021-04-29 15:44:25.943 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [589212831-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@40f612ab at consistency null
2021-04-29 15:44:25.943 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [589212831-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:44:26.163 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.226.88:9042, scheduling delivery
2021-04-29 15:44:26.164 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] received event UP
2021-04-29 15:44:27.166 DEBUG 10 --- [uster-worker-26] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.226.88:9042
2021-04-29 15:44:57.173 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:44:57.216 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:45:11.151 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:45:11.153 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:45:27.216 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:45:27.218 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:45:57.220 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:45:57.223 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:46:27.224 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:46:27.225 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:46:57.226 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:46:57.228 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:47:27.228 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:47:27.230 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:47:57.246 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:47:57.248 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:48:01.493 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:48:01.537 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:48:27.259 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:48:27.260 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:48:53.053 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 4
2021-04-29 15:48:57.261 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:48:57.263 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:48:58.058 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-31, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (connection timed out: /10.242.64.133:9042)
2021-04-29 15:48:58.058 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-31, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 15:48:58.059 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-31, inFlight=0, closed=true] closing connection
2021-04-29 15:48:58.059 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 600000 milliseconds
2021-04-29 15:48:58.059 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 600000 ms
2021-04-29 15:49:27.263 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:49:27.265 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:49:57.270 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:49:57.316 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:50:02.559 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:50:02.562 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:50:02.936 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 15:50:02.936 DEBUG 10 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.64.158:9042
2021-04-29 15:50:02.940 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Successful reconnection to /10.242.64.158:9042, setting host UP
2021-04-29 15:50:02.940 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] adding host
2021-04-29 15:50:02.940 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.64.158:9042
2021-04-29 15:50:02.949 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.158:9042] preparing to open 0 new connections, total = 1
2021-04-29 15:50:02.949 DEBUG 10 --- [-reconnection-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.64.158:9042 (1 connections needed, 1 successfully opened)
2021-04-29 15:50:02.949 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Session : Added connection pool for /10.242.64.158:9042
2021-04-29 15:50:02.950 DEBUG 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2021-04-29 15:50:03.952 DEBUG 10 --- [uster-worker-27] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2021-04-29 15:50:03.958 DEBUG 10 --- [uster-worker-27] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:50:03.964 DEBUG 10 --- [uster-worker-27] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 6 milliseconds
2021-04-29 15:50:12.036 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.226.88:9042, scheduling delivery
2021-04-29 15:50:12.036 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] received event DOWN
2021-04-29 15:50:13.036 DEBUG 10 --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.226.88:9042 because it still has active connections
2021-04-29 15:50:33.049 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-04-29T15:50:17.614Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124)
at com.datastax.driver.core.Responses$Error.asException(Responses.java:169)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91)
at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297)
at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88)
... 26 common frames omitted
2021-04-29 15:50:42.046 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:50:42.047 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:50:48.212 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:50:48.213 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:51:03.067 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:51:12.055 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:51:12.116 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:51:15.072 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] because: [/10.242.226.88:9042] Heartbeat query timed out
2021-04-29 15:51:15.073 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preventing new connections for the next 1000 ms
2021-04-29 15:51:15.073 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-11, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:51:15.074 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=true] closing connection
2021-04-29 15:51:15.074 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-11, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:51:15.074 DEBUG 10 --- [uster-worker-28] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] marking host DOWN
2021-04-29 15:51:15.076 DEBUG 10 --- [uster-worker-28] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:51:15.076 DEBUG 10 --- [uster-worker-28] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] starting reconnection attempt
2021-04-29 15:51:16.076 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:51:16.078 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-12, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:51:28.173 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-12, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:51:28.173 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-12, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:51:28.174 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-12, inFlight=0, closed=true] closing connection
2021-04-29 15:51:28.174 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-12, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:51:28.174 DEBUG 10 --- [uster-worker-29] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:51:28.174 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 2000 milliseconds
2021-04-29 15:51:28.175 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 2000 ms
2021-04-29 15:51:30.175 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:51:30.177 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-13, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:51:42.117 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:51:42.118 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:51:42.272 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-13, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:51:42.273 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-13, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:51:42.273 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-13, inFlight=0, closed=true] closing connection
2021-04-29 15:51:42.273 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-13, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:51:42.273 DEBUG 10 --- [uster-worker-28] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:51:42.273 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 4000 milliseconds
2021-04-29 15:51:42.273 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 4000 ms
2021-04-29 15:51:43.619 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-11, inFlight=0, closed=true] has already terminated
2021-04-29 15:51:46.274 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:51:46.275 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-14, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:51:58.372 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-14, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:51:58.372 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-14, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:51:58.373 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-14, inFlight=0, closed=true] closing connection
2021-04-29 15:51:58.373 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-14, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:51:58.373 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 8000 milliseconds
2021-04-29 15:51:58.373 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:51:58.373 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 8000 ms
2021-04-29 15:51:58.619 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-12, inFlight=0, closed=true] has already terminated
2021-04-29 15:52:06.374 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:52:06.375 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-15, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:52:12.147 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:52:12.215 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:52:13.620 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-13, inFlight=0, closed=true] has already terminated
2021-04-29 15:52:18.472 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-15, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:52:18.472 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-15, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:52:18.473 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-15, inFlight=0, closed=true] closing connection
2021-04-29 15:52:18.473 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-15, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:52:18.473 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:52:18.474 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 16000 milliseconds
2021-04-29 15:52:18.474 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 16000 ms
2021-04-29 15:52:28.621 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-14, inFlight=0, closed=true] has already terminated
2021-04-29 15:52:34.474 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:52:34.478 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-16, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:52:42.217 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:52:42.218 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:52:43.622 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-15, inFlight=0, closed=true] has already terminated
2021-04-29 15:52:46.573 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-16, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:52:46.573 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-16, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:52:46.574 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-16, inFlight=0, closed=true] closing connection
2021-04-29 15:52:46.574 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-16, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:52:46.574 DEBUG 10 --- [uster-worker-32] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:52:46.575 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 32000 milliseconds
2021-04-29 15:52:46.575 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 32000 ms
2021-04-29 15:53:12.247 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:53:12.316 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:53:13.623 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-16, inFlight=0, closed=true] has already terminated
2021-04-29 15:53:18.575 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:53:18.577 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-17, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:53:30.672 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-17, inFlight=0, closed=false] because: [/10.242.226.88:9042] Operation timed out
2021-04-29 15:53:30.672 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-17, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:53:30.673 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-17, inFlight=0, closed=true] closing connection
2021-04-29 15:53:30.673 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.226.88:9042-17, inFlight=0, closed=true]: there are still pending requests
2021-04-29 15:53:30.673 DEBUG 10 --- [uster-worker-33] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:53:30.674 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Operation timed out), scheduling retry in 64000 milliseconds
2021-04-29 15:53:30.674 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 64000 ms
2021-04-29 15:53:42.316 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:53:42.319 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:53:58.624 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-17, inFlight=0, closed=true] has already terminated
2021-04-29 15:54:12.343 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:54:12.416 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:54:34.674 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:54:34.678 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:54:42.416 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:54:42.418 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:54:46.543 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 15:54:46.544 DEBUG 10 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.226.88:9042
2021-04-29 15:54:46.547 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Successful reconnection to /10.242.226.88:9042, setting host UP
2021-04-29 15:54:46.548 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] marking host UP
2021-04-29 15:54:46.548 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2021-04-29 15:54:46.548 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.226.88:9042
2021-04-29 15:54:49.572 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 0 new connections, total = 1
2021-04-29 15:54:49.572 DEBUG 10 --- [-reconnection-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.226.88:9042 (1 connections needed, 1 successfully opened)
2021-04-29 15:54:49.572 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Session : Added connection pool for /10.242.226.88:9042
2021-04-29 15:54:49.573 DEBUG 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2021-04-29 15:54:56.138 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1865631623-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@72bb5fc1 at consistency null
2021-04-29 15:54:56.139 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1865631623-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:55:02.944 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1970880821-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@676aebeb at consistency null
2021-04-29 15:55:02.944 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1970880821-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:55:10.032 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1298117974-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6b68f937 at consistency null
2021-04-29 15:55:10.032 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1298117974-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:55:15.612 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [268825803-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@26f4d8b3 at consistency null
2021-04-29 15:55:15.612 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [268825803-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:55:16.547 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:55:16.549 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:55:45.618 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:55:46.575 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:55:46.577 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:55:52.252 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1396471156-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@e19cefb at consistency null
2021-04-29 15:55:52.252 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1396471156-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:55:52.259 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:55:59.138 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1235017589-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3e9c5960 at consistency null
2021-04-29 15:55:59.138 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [1235017589-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:56:16.605 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:56:16.616 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:56:26.273 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [571932262-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7104ca51 at consistency LOCAL_QUORUM
2021-04-29 15:56:26.273 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.RequestHandler : [571932262-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.OperationTimedOutException: [/10.242.226.88:9042] Timed out waiting for server response
2021-04-29 15:56:29.142 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:56:29.203 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:56:29.205 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:56:31.859 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] Response received on stream 4096 but no handler set anymore (either the request has timed out or it was closed due to another error). Received message is ERROR UNAVAILABLE: Cannot achieve consistency level LOCAL_QUORUM
2021-04-29 15:56:36.163 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:56:46.634 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:56:46.636 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:57:04.399 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [610552703-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1291bec5 at consistency null
2021-04-29 15:57:04.400 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.RequestHandler : [610552703-0] Error querying /10.242.226.88:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2021-04-29 15:57:13.100 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.226.88:9042, scheduling delivery
2021-04-29 15:57:13.101 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] received event UP
2021-04-29 15:57:14.103 DEBUG 10 --- [uster-worker-34] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.226.88:9042
2021-04-29 15:57:34.403 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:57:34.416 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:57:44.118 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:57:44.120 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:58:06.334 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-29 15:58:06.334 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] because: [/10.242.226.88:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2021-04-29 15:58:06.334 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preventing new connections for the next 1000 ms
2021-04-29 15:58:06.334 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-18, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:58:06.336 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-18, inFlight=0, closed=true] closing connection
2021-04-29 15:58:06.336 DEBUG 10 --- [uster-worker-35] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] marking host DOWN
2021-04-29 15:58:06.337 DEBUG 10 --- [uster-worker-35] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2021-04-29 15:58:06.337 DEBUG 10 --- [uster-worker-35] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] starting reconnection attempt
2021-04-29 15:58:06.343 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.226.88:9042, scheduling delivery
2021-04-29 15:58:06.344 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] received event DOWN
2021-04-29 15:58:07.337 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:58:07.340 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-19, inFlight=0, closed=false] Error connecting to /10.242.226.88:9042 (Connection refused: /10.242.226.88:9042)
2021-04-29 15:58:07.340 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-19, inFlight=0, closed=false] because: [/10.242.226.88:9042] Cannot connect
2021-04-29 15:58:07.341 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-19, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:58:07.341 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-19, inFlight=0, closed=true] closing connection
2021-04-29 15:58:07.341 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:58:07.342 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Cannot connect), scheduling retry in 2000 milliseconds
2021-04-29 15:58:07.342 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 2000 ms
2021-04-29 15:58:07.345 DEBUG 10 --- [uster-worker-35] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:58:09.342 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:58:09.344 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-20, inFlight=0, closed=false] Error connecting to /10.242.226.88:9042 (Connection refused: /10.242.226.88:9042)
2021-04-29 15:58:09.344 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-20, inFlight=0, closed=false] because: [/10.242.226.88:9042] Cannot connect
2021-04-29 15:58:09.345 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-20, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:58:09.345 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-20, inFlight=0, closed=true] closing connection
2021-04-29 15:58:09.345 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:58:09.345 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Cannot connect), scheduling retry in 4000 milliseconds
2021-04-29 15:58:09.345 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 4000 ms
2021-04-29 15:58:09.608 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:58:09.609 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:58:13.345 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:58:13.347 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-21, inFlight=0, closed=false] Error connecting to /10.242.226.88:9042 (Connection refused: /10.242.226.88:9042)
2021-04-29 15:58:13.347 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-21, inFlight=0, closed=false] because: [/10.242.226.88:9042] Cannot connect
2021-04-29 15:58:13.347 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-21, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:58:13.347 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-21, inFlight=0, closed=true] closing connection
2021-04-29 15:58:13.348 DEBUG 10 --- [uster-worker-35] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:58:13.348 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Cannot connect), scheduling retry in 8000 milliseconds
2021-04-29 15:58:13.348 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 8000 ms
2021-04-29 15:58:21.348 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:58:26.352 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-22, inFlight=0, closed=false] Error connecting to /10.242.226.88:9042 (connection timed out: /10.242.226.88:9042)
2021-04-29 15:58:26.352 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-22, inFlight=0, closed=false] because: [/10.242.226.88:9042] Cannot connect
2021-04-29 15:58:26.352 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-22, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:58:26.352 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-22, inFlight=0, closed=true] closing connection
2021-04-29 15:58:26.353 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:58:26.353 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Cannot connect), scheduling retry in 16000 milliseconds
2021-04-29 15:58:26.353 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 16000 ms
2021-04-29 15:58:36.367 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:58:36.416 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:58:42.353 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:58:47.359 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-23, inFlight=0, closed=false] Error connecting to /10.242.226.88:9042 (connection timed out: /10.242.226.88:9042)
2021-04-29 15:58:47.359 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-23, inFlight=0, closed=false] because: [/10.242.226.88:9042] Cannot connect
2021-04-29 15:58:47.359 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-23, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:58:47.359 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-23, inFlight=0, closed=true] closing connection
2021-04-29 15:58:47.360 DEBUG 10 --- [uster-worker-37] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:58:47.360 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Cannot connect), scheduling retry in 32000 milliseconds
2021-04-29 15:58:47.360 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 32000 ms
2021-04-29 15:58:58.060 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 5
2021-04-29 15:59:03.067 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-32, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (connection timed out: /10.242.64.133:9042)
2021-04-29 15:59:03.068 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-32, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 15:59:03.068 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-32, inFlight=0, closed=true] closing connection
2021-04-29 15:59:03.069 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 600000 milliseconds
2021-04-29 15:59:03.069 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 600000 ms
2021-04-29 15:59:06.416 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:59:06.418 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:59:19.360 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:59:24.362 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-24, inFlight=0, closed=false] Error connecting to /10.242.226.88:9042 (connection timed out: /10.242.226.88:9042)
2021-04-29 15:59:24.363 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-24, inFlight=0, closed=false] because: [/10.242.226.88:9042] Cannot connect
2021-04-29 15:59:24.363 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] Connection[/10.242.226.88:9042-24, inFlight=0, closed=false] failed, remaining = 0
2021-04-29 15:59:24.364 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-24, inFlight=0, closed=true] closing connection
2021-04-29 15:59:24.364 DEBUG 10 --- [uster-worker-38] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.226.88:9042
2021-04-29 15:59:24.365 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Cannot connect), scheduling retry in 64000 milliseconds
2021-04-29 15:59:24.365 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 64000 ms
2021-04-29 15:59:36.447 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:59:36.448 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 15:59:46.441 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT NEW_NODE /10.242.226.109:9042, scheduling delivery
2021-04-29 15:59:46.441 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.109:9042] received event NEW_NODE
2021-04-29 15:59:46.442 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.242.226.109:9042, scheduling delivery
2021-04-29 15:59:46.442 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.226.109:9042] received event UP
2021-04-29 15:59:47.445 DEBUG 10 --- [uster-worker-39] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.242.226.109:9042
2021-04-29 15:59:47.451 DEBUG 10 --- [uster-worker-39] com.datastax.driver.core.Host.STATES : [/10.242.226.109:9042] adding host
2021-04-29 15:59:47.451 DEBUG 10 --- [uster-worker-39] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.226.109:9042
2021-04-29 15:59:47.451 DEBUG 10 --- [uster-worker-39] com.datastax.driver.core.Host.STATES : [/10.242.226.109:9042] preparing to open 1 new connections, total = 1
2021-04-29 15:59:47.460 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2021-04-29 15:59:50.445 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.226.109:9042] Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2021-04-29 15:59:50.746 DEBUG 10 --- [uster-worker-39] com.datastax.driver.core.Host.STATES : [/10.242.226.109:9042] preparing to open 0 new connections, total = 1
2021-04-29 15:59:50.746 DEBUG 10 --- [uster-worker-39] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.226.109:9042 (1 connections needed, 1 successfully opened)
2021-04-29 15:59:50.746 DEBUG 10 --- [uster-worker-39] com.datastax.driver.core.Session : Added connection pool for /10.242.226.109:9042
2021-04-29 15:59:51.747 DEBUG 10 --- [uster-worker-38] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2021-04-29 15:59:51.817 INFO 10 --- [uster-worker-38] com.datastax.driver.core.Cluster : Cassandra host /10.242.226.88:9042 removed
2021-04-29 15:59:51.817 DEBUG 10 --- [uster-worker-39] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] removing host
2021-04-29 15:59:51.818 DEBUG 10 --- [uster-worker-38] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2021-04-29 15:59:51.822 DEBUG 10 --- [uster-worker-38] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 4 milliseconds
2021-04-29 15:59:59.422 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 15:59:59.424 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:00:19.627 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:00:19.702 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:00:21.831 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:00:21.832 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:00:28.365 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 1
2021-04-29 16:00:33.371 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-25, inFlight=0, closed=false] Error connecting to /10.242.226.88:9042 (connection timed out: /10.242.226.88:9042)
2021-04-29 16:00:33.371 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-25, inFlight=0, closed=false] because: [/10.242.226.88:9042] Cannot connect
2021-04-29 16:00:33.371 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-25, inFlight=0, closed=true] closing connection
2021-04-29 16:00:33.372 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Cannot connect), scheduling retry in 128000 milliseconds
2021-04-29 16:00:33.372 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 128000 ms
2021-04-29 16:00:44.741 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:00:44.743 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:00:51.848 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:00:51.916 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:00:59.759 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:00:59.762 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:01:21.917 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:01:21.919 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:01:44.958 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:01:44.987 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:01:51.946 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:01:52.016 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:02:14.989 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:02:14.991 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:02:22.017 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:02:22.018 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:02:41.373 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 2
2021-04-29 16:02:44.993 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:02:44.994 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:02:46.377 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-26, inFlight=0, closed=false] Error connecting to /10.242.226.88:9042 (connection timed out: /10.242.226.88:9042)
2021-04-29 16:02:46.378 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-26, inFlight=0, closed=false] because: [/10.242.226.88:9042] Cannot connect
2021-04-29 16:02:46.378 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-26, inFlight=0, closed=true] closing connection
2021-04-29 16:02:46.378 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Cannot connect), scheduling retry in 256000 milliseconds
2021-04-29 16:02:46.378 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 256000 ms
2021-04-29 16:02:52.045 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:02:52.116 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:03:10.169 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:03:10.216 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:03:22.117 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:03:22.118 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:03:45.425 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:03:45.432 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:03:52.146 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:03:52.216 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:04:10.535 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:04:10.536 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:04:22.217 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:04:22.218 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:04:30.610 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:04:30.612 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:04:35.638 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:04:35.640 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:04:52.235 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:04:52.240 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:04:55.795 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:04:55.816 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:05:22.263 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:05:22.265 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:05:45.956 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:05:45.957 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:05:52.271 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:05:52.316 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:06:11.039 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:06:11.041 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:06:22.317 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:06:22.318 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:06:36.196 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:06:36.197 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:06:52.326 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:06:52.327 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:07:02.379 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 3
2021-04-29 16:07:07.386 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-27, inFlight=0, closed=false] Error connecting to /10.242.226.88:9042 (connection timed out: /10.242.226.88:9042)
2021-04-29 16:07:07.387 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-27, inFlight=0, closed=false] because: [/10.242.226.88:9042] Cannot connect
2021-04-29 16:07:07.387 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-27, inFlight=0, closed=true] closing connection
2021-04-29 16:07:07.389 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Cannot connect), scheduling retry in 512000 milliseconds
2021-04-29 16:07:07.389 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 512000 ms
2021-04-29 16:07:21.546 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:07:21.553 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:07:22.354 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:07:22.356 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:07:36.697 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:07:36.698 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:07:51.835 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:07:51.840 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:07:52.382 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:07:52.416 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:08:21.843 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:08:21.845 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:08:22.416 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:08:22.418 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:08:52.446 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:08:52.516 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:09:02.239 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:09:02.241 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:09:03.070 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] preparing to open 1 new connections, total = 6
2021-04-29 16:09:08.078 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-33, inFlight=0, closed=false] Error connecting to /10.242.64.133:9042 (connection timed out: /10.242.64.133:9042)
2021-04-29 16:09:08.079 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.64.133:9042-33, inFlight=0, closed=false] because: [/10.242.64.133:9042] Cannot connect
2021-04-29 16:09:08.079 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.64.133:9042-33, inFlight=0, closed=true] closing connection
2021-04-29 16:09:08.080 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.64.133:9042 ([/10.242.64.133:9042] Cannot connect), scheduling retry in 600000 milliseconds
2021-04-29 16:09:08.080 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.64.133:9042] next reconnection attempt in 600000 ms
2021-04-29 16:09:17.347 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:09:17.388 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:09:22.517 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:09:22.518 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:09:32.433 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:09:32.434 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:09:52.543 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:09:52.545 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:09:52.547 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:09:52.636 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:10:22.637 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:10:22.639 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:10:47.709 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:10:47.732 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:10:52.668 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:10:52.717 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:11:07.907 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:11:07.909 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:11:17.733 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:11:17.734 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:11:22.718 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:11:22.719 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:11:48.127 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:11:48.132 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:11:52.748 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:11:52.749 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:12:22.750 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:12:22.753 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:12:23.237 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:12:23.239 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:12:52.779 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:12:52.816 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:12:58.437 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:12:58.439 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:13:22.817 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:13:22.818 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:13:28.497 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:13:28.499 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:13:52.847 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:13:52.850 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:13:58.557 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:13:58.588 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:14:13.620 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:14:13.622 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:14:22.859 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:14:22.860 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:14:28.689 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:14:28.691 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.64.158:9042-12, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:14:48.752 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:14:48.753 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:14:52.878 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:14:52.882 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:15:22.906 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:15:22.908 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:15:39.389 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] preparing to open 1 new connections, total = 4
2021-04-29 16:15:44.398 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-28, inFlight=0, closed=false] Error connecting to /10.242.226.88:9042 (connection timed out: /10.242.226.88:9042)
2021-04-29 16:15:44.398 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.226.88:9042-28, inFlight=0, closed=false] because: [/10.242.226.88:9042] Cannot connect
2021-04-29 16:15:44.398 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.226.88:9042-28, inFlight=0, closed=true] closing connection
2021-04-29 16:15:44.399 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.226.88:9042 ([/10.242.226.88:9042] Cannot connect), scheduling retry in 600000 milliseconds
2021-04-29 16:15:44.399 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.226.88:9042] next reconnection attempt in 600000 ms
2021-04-29 16:15:52.915 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:15:52.916 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:15:58.945 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:15:58.947 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:16:22.934 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:16:22.936 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:16:44.047 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:16:44.049 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:16:52.953 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:16:52.955 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:17:14.106 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:17:14.107 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:17:22.968 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:17:22.969 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.76.214:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2021-04-29 16:17:39.140 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2021-04-29 16:17:39.142 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.226.109:9042-1, inFlight=0, closed=false] heartbeat query succeeded