By type
*** retrieve Truststore and Keystore password
*** actual launch of AAI Resources
2022-01-06 09:40:36.066 INFO --- [ main] org.onap.aai.util.AAIConfig : Initializing AAIConfig
2022-01-06 09:40:36.073 DEBUG --- [ main] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2022-01-06 09:40:36.074 INFO --- [ main] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2022-01-06 09:40:36.076 INFO --- [ main] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename
2022-01-06 09:40:37.821 WARN 10 --- [ main] o.s.b.l.logback.LogbackLoggingSystem : Ignoring 'logback.configurationFile' system property. Please use 'logging.config' instead.
2022-01-06 09:40:37.827 DEBUG 10 --- [kground-preinit] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.messageinterpolation.ResourceBundleMessageInterpolator as ValidatorFactory-scoped message interpolator.
2022-01-06 09:40:37.827 DEBUG 10 --- [kground-preinit] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.resolver.JPATraversableResolver as ValidatorFactory-scoped traversable resolver.
2022-01-06 09:40:37.827 DEBUG 10 --- [kground-preinit] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.util.ExecutableParameterNameProvider as ValidatorFactory-scoped parameter name provider.
2022-01-06 09:40:37.827 DEBUG 10 --- [kground-preinit] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.DefaultClockProvider as ValidatorFactory-scoped clock provider.
2022-01-06 09:40:37.828 DEBUG 10 --- [kground-preinit] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.scripting.DefaultScriptEvaluatorFactory as ValidatorFactory-scoped script evaluator factory.
. ____ _ __ _ _
/\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
\\/ ___)| |_)| | | | | || (_| | ) ) ) )
' |____| .__|_| |_|_| |_\__, | / / / /
=========|_|==============|___/=/_/_/_/
:: Spring Boot :: (v2.1.12.RELEASE)
09:40:44,247 |-INFO in LogbackRequestLog - Will use configuration resource [/localhost-access-logback.xml]
09:40:44,254 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - debug attribute not set
09:40:44,254 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
09:40:44,254 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS]
09:40:44,255 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2089589253 - No compression will be used
09:40:44,255 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@2089589253 - Will use the pattern /opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd} for the active file
09:40:44,256 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - The date pattern is 'yyyy-MM-dd' from file name pattern '/opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd}'.
09:40:44,256 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Roll-over at midnight.
09:40:44,256 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Setting initial period to Thu Jan 06 09:40:44 GMT 2022
09:40:44,275 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - Active log file name: /opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log
09:40:44,275 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - File property is set to [/opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log]
09:40:44,275 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS] to null
09:40:44,275 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - End of configuration.
09:40:44,275 |-INFO in ch.qos.logback.access.joran.JoranConfigurator@d41f816 - Registering current configuration as safe fallback point
2022-01-06 09:40:44.492 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED CLASSES [class org.onap.aai.rest.search.ModelAndNamedQueryRestProvider, class org.onap.aai.rest.RecentAPIConsumer, class org.onap.aai.rest.CQ2GremlinTest, class org.onap.aai.rest.CQ2Gremlin, class org.onap.aai.rest.DslConsumer, class org.onap.aai.rest.QueryConsumer, class org.onap.aai.rest.util.EchoResponse, class org.onap.aai.rest.search.SearchProvider]
2022-01-06 09:40:44.496 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RetiredInterceptor result=true
2022-01-06 09:40:44.496 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.InvalidResponseStatus result=true
2022-01-06 09:40:44.497 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionLatestInterceptor result=true
2022-01-06 09:40:44.497 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseTransactionLogging result=true
2022-01-06 09:40:44.498 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestModification result=true
2022-01-06 09:40:44.499 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestTransactionLogging result=true
2022-01-06 09:40:44.499 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseHeaderManipulation result=true
2022-01-06 09:40:44.500 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionInterceptor result=true
2022-01-06 09:40:44.500 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestHeaderManipulation result=true
2022-01-06 09:40:44.501 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HttpHeaderInterceptor result=true
2022-01-06 09:40:44.501 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.OneWaySslAuthorization result=true
2022-01-06 09:40:44.502 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HeaderValidation result=true
2022-01-06 09:40:44.506 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RetiredInterceptor result=true
2022-01-06 09:40:44.506 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.InvalidResponseStatus result=true
2022-01-06 09:40:44.507 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionLatestInterceptor result=true
2022-01-06 09:40:44.507 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseTransactionLogging result=true
2022-01-06 09:40:44.508 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestModification result=true
2022-01-06 09:40:44.508 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestTransactionLogging result=true
2022-01-06 09:40:44.509 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseHeaderManipulation result=true
2022-01-06 09:40:44.509 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionInterceptor result=true
2022-01-06 09:40:44.510 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestHeaderManipulation result=true
2022-01-06 09:40:44.510 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HttpHeaderInterceptor result=true
2022-01-06 09:40:44.511 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.OneWaySslAuthorization result=true
2022-01-06 09:40:44.511 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HeaderValidation result=true
2022-01-06 09:40:44.512 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.post.InvalidResponseStatus
2022-01-06 09:40:44.513 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RequestTransactionLogging
2022-01-06 09:40:44.513 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.HeaderValidation
2022-01-06 09:40:44.514 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.post.ResponseTransactionLogging
2022-01-06 09:40:44.514 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.post.ResponseHeaderManipulation
2022-01-06 09:40:44.515 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.HttpHeaderInterceptor
2022-01-06 09:40:44.515 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.VersionLatestInterceptor
2022-01-06 09:40:44.516 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.OneWaySslAuthorization
2022-01-06 09:40:44.516 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RetiredInterceptor
2022-01-06 09:40:44.517 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.VersionInterceptor
2022-01-06 09:40:44.517 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RequestHeaderManipulation
2022-01-06 09:40:44.518 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RequestModification
2022-01-06 09:40:44.872 DEBUG 10 --- [ main] i.m.c.u.i.logging.InternalLoggerFactory : Using SLF4J as the default logging framework
2022-01-06 09:40:46.522 INFO 10 --- [ main] org.onap.aai.config.NodesConfiguration : Translator is SchemaServiceTranslator
2022-01-06 09:40:46.876 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:40:46.877 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:40:46.877 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:40:46.878 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:40:46.881 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/versions, BODY=
2022-01-06 09:40:47.007 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:40:47.007 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:40:47.007 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:40:47.009 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:40:47.484 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:40:47.592 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Processing the translator
2022-01-06 09:40:47.593 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv11
2022-01-06 09:40:47.593 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:40:47.666 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:40:47.667 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:40:47.667 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:40:47.667 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:40:47.695 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:40:47.734 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:40:47.734 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:40:47.735 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:40:51.741 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 222
2022-01-06 09:40:51.765 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv12
2022-01-06 09:40:51.765 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:40:51.768 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:40:51.768 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:40:51.768 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:40:51.768 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:40:51.796 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:40:51.819 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:40:51.820 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:40:51.820 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:40:53.492 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 235
2022-01-06 09:40:53.505 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv13
2022-01-06 09:40:53.506 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:40:53.508 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:40:53.508 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:40:53.508 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:40:53.508 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:40:53.530 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:40:53.548 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:40:53.549 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:40:53.550 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:40:54.936 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 237
2022-01-06 09:40:54.953 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv14
2022-01-06 09:40:54.954 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:40:54.956 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:40:54.956 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:40:54.956 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:40:54.956 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:40:55.005 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:40:55.026 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:40:55.027 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:40:55.027 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:40:57.101 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 272
2022-01-06 09:40:57.117 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv15
2022-01-06 09:40:57.117 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:40:57.120 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:40:57.120 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:40:57.120 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:40:57.120 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:40:57.145 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:40:57.165 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:40:57.166 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:40:57.167 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:40:59.142 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 279
2022-01-06 09:40:59.156 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv16
2022-01-06 09:40:59.156 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:40:59.159 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:40:59.159 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:40:59.159 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:40:59.159 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:40:59.182 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:40:59.213 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:40:59.214 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:40:59.214 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:41:00.805 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2022-01-06 09:41:00.818 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv17
2022-01-06 09:41:00.818 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:41:00.820 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:00.820 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:00.820 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:00.821 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:00.846 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:00.870 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:00.871 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:41:00.871 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:41:03.036 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2022-01-06 09:41:03.046 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv18
2022-01-06 09:41:03.047 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:41:03.049 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:03.049 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:03.049 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:03.049 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:03.071 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:03.097 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:03.098 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:41:03.098 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:41:05.097 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2022-01-06 09:41:05.109 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv19
2022-01-06 09:41:05.109 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:41:05.111 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:05.112 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:05.112 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:05.112 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:05.131 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:05.157 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:05.158 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:41:05.158 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:41:06.828 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 301
2022-01-06 09:41:06.838 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv20
2022-01-06 09:41:06.839 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:41:06.841 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:06.841 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:06.841 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:06.841 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:06.858 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:06.915 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:06.915 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:41:06.916 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:41:08.791 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 305
2022-01-06 09:41:08.802 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv21
2022-01-06 09:41:08.803 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:41:08.805 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:08.805 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:08.805 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:08.805 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:08.826 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:08.854 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:08.854 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:41:08.855 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:41:10.824 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 371
2022-01-06 09:41:10.836 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv22
2022-01-06 09:41:10.836 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:41:10.839 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:10.839 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:10.839 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:10.839 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:10.866 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:10.906 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:10.906 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:41:10.907 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:41:13.065 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378
2022-01-06 09:41:13.110 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv23
2022-01-06 09:41:13.111 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:41:13.113 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:13.113 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:13.113 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:13.113 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:13.136 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:13.167 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:13.168 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:41:13.168 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:41:15.395 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378
2022-01-06 09:41:15.409 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv24
2022-01-06 09:41:15.410 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-01-06 09:41:15.412 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:15.412 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:15.412 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:15.412 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:15.437 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:15.476 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:15.477 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-01-06 09:41:15.477 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-01-06 09:41:17.626 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 406
2022-01-06 09:41:17.650 DEBUG 10 --- [ main] org.onap.aai.TraversalApp : AAI Server initialization started...
2022-01-06 09:41:17.651 DEBUG 10 --- [ main] org.onap.aai.TraversalApp : Starting AAIGraph connections and the NodeInjestor
2022-01-06 09:41:17.651 INFO 10 --- [ main] org.onap.aai.util.AAIConfig : Initializing AAIConfig
2022-01-06 09:41:17.651 DEBUG 10 --- [ main] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2022-01-06 09:41:17.652 INFO 10 --- [ main] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2022-01-06 09:41:17.652 INFO 10 --- [ main] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename
2022-01-06 09:41:18.047 INFO 10 --- [ main] com.datastax.driver.core : DataStax Java driver 3.6.0 for Apache Cassandra
2022-01-06 09:41:18.058 INFO 10 --- [ main] c.d.driver.core.GuavaCompatibility : Detected Guava >= 19 in the classpath, using modern compatibility layer
2022-01-06 09:41:18.059 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NEW_NODE_DELAY_SECONDS is undefined, using default value 1
2022-01-06 09:41:18.059 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NOTIF_LOCK_TIMEOUT_SECONDS is undefined, using default value 60
2022-01-06 09:41:18.081 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2022-01-06 09:41:18.392 INFO 10 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2022-01-06 09:41:18.406 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NON_BLOCKING_EXECUTOR_SIZE is undefined, using default value 2
2022-01-06 09:41:18.524 DEBUG 10 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.233.71.39:9042]
2022-01-06 09:41:18.564 DEBUG 10 --- [ main] i.n.u.i.logging.InternalLoggerFactory : Using SLF4J as the default logging framework
2022-01-06 09:41:18.587 DEBUG 10 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024
2022-01-06 09:41:18.587 DEBUG 10 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096
2022-01-06 09:41:18.649 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : -Dio.netty.noUnsafe: false
2022-01-06 09:41:18.650 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : Java version: 8
2022-01-06 09:41:18.653 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.theUnsafe: available
2022-01-06 09:41:18.654 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.copyMemory: available
2022-01-06 09:41:18.655 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Buffer.address: available
2022-01-06 09:41:18.656 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : direct buffer constructor: available
2022-01-06 09:41:18.657 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Bits.unaligned: available, true
2022-01-06 09:41:18.657 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9
2022-01-06 09:41:18.657 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.DirectByteBuffer.(long, int): available
2022-01-06 09:41:18.657 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : sun.misc.Unsafe: available
2022-01-06 09:41:18.658 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
2022-01-06 09:41:18.658 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.bitMode: 64 (sun.arch.data.model)
2022-01-06 09:41:18.660 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.maxDirectMemory: 1020067840 bytes
2022-01-06 09:41:18.661 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.uninitializedArrayAllocationThreshold: -1
2022-01-06 09:41:18.662 DEBUG 10 --- [ main] io.netty.util.internal.CleanerJava6 : java.nio.ByteBuffer.cleaner(): available
2022-01-06 09:41:18.663 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.noPreferDirect: false
2022-01-06 09:41:18.670 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FORCE_NIO is undefined, using default value false
2022-01-06 09:41:18.677 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.workdir: /tmp (io.netty.tmpdir)
2022-01-06 09:41:18.677 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.deleteLibAfterLoading: true
2022-01-06 09:41:18.677 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.tryPatchShadedId: true
2022-01-06 09:41:18.682 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library 'netty_transport_native_epoll_x86_64', trying other loading mechanism.
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
2022-01-06 09:41:18.683 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : netty_transport_native_epoll_x86_64 cannot be loaded from java.library.path, now trying export to -Dio.netty.native.workdir: /tmp
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
2022-01-06 09:41:18.707 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library '/tmp/libnetty_transport_native_epoll_x86_644900551088833814116.so', trying other loading mechanism.
java.lang.UnsatisfiedLinkError: null
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:382)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:203)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
Caused by: java.lang.reflect.InvocationTargetException: null
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
... 65 common frames omitted
Caused by: java.lang.RuntimeException: failed to get field ID: DefaultFileRegion.transfered
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:36)
... 72 common frames omitted
2022-01-06 09:41:18.709 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library 'netty_transport_native_epoll', trying other loading mechanism.
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:290)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
2022-01-06 09:41:18.710 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : netty_transport_native_epoll cannot be loaded from java.library.path, now trying export to -Dio.netty.native.workdir: /tmp
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:290)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
2022-01-06 09:41:18.712 WARN 10 --- [ main] com.datastax.driver.core.NettyUtil : Found Netty's native epoll transport in the classpath, but epoll is not available. Using NIO instead.
java.lang.UnsatisfiedLinkError: could not load a native library: netty_transport_native_epoll_x86_64
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:224)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287)
at io.netty.channel.epoll.Native.(Native.java:69)
at io.netty.channel.epoll.Epoll.(Epoll.java:33)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
... 63 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: could not load a native library: netty_transport_native_epoll
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:224)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:290)
... 62 common frames omitted
Caused by: java.io.FileNotFoundException: META-INF/native/libnetty_transport_native_epoll.so
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:173)
... 63 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
... 63 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
Caused by: java.lang.RuntimeException: failed to get field ID: DefaultFileRegion.transfered
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:36)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:203)
... 63 common frames omitted
2022-01-06 09:41:18.722 DEBUG 10 --- [ main] i.n.channel.MultithreadEventLoopGroup : -Dio.netty.eventLoopThreads: 4
2022-01-06 09:41:18.741 DEBUG 10 --- [ main] io.netty.channel.nio.NioEventLoop : -Dio.netty.noKeySetOptimization: false
2022-01-06 09:41:18.741 DEBUG 10 --- [ main] io.netty.channel.nio.NioEventLoop : -Dio.netty.selectorAutoRebuildThreshold: 512
2022-01-06 09:41:18.762 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : org.jctools-core.MpscChunkedArrayQueue: available
2022-01-06 09:41:18.791 DEBUG 10 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.level: simple
2022-01-06 09:41:18.791 DEBUG 10 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.targetRecords: 4
2022-01-06 09:41:18.791 DEBUG 10 --- [ main] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@7220ff10
2022-01-06 09:41:18.800 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.EXTENDED_PEER_CHECK is undefined, using default value true
2022-01-06 09:41:18.862 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.71.39:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:18.867 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.DISABLE_COALESCING is undefined, using default value false
2022-01-06 09:41:18.867 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_SCHEDULE_PERIOD_NS is undefined, using default value 10000
2022-01-06 09:41:18.868 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_RUN_WITHOUT_WORK_TIMES is undefined, using default value 5
2022-01-06 09:41:18.934 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numHeapArenas: 4
2022-01-06 09:41:18.934 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numDirectArenas: 4
2022-01-06 09:41:18.934 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.pageSize: 8192
2022-01-06 09:41:18.934 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxOrder: 11
2022-01-06 09:41:18.934 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.chunkSize: 16777216
2022-01-06 09:41:18.934 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.tinyCacheSize: 512
2022-01-06 09:41:18.934 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.smallCacheSize: 256
2022-01-06 09:41:18.934 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.normalCacheSize: 64
2022-01-06 09:41:18.934 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxCachedBufferCapacity: 32768
2022-01-06 09:41:18.934 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.cacheTrimInterval: 8192
2022-01-06 09:41:18.935 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.cacheTrimIntervalMillis: 0
2022-01-06 09:41:18.935 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.useCacheForAllThreads: true
2022-01-06 09:41:18.935 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023
2022-01-06 09:41:19.006 DEBUG 10 --- [ main] io.netty.channel.DefaultChannelId : -Dio.netty.processId: 10 (auto-detected)
2022-01-06 09:41:19.010 DEBUG 10 --- [ main] io.netty.util.NetUtil : -Djava.net.preferIPv4Stack: false
2022-01-06 09:41:19.010 DEBUG 10 --- [ main] io.netty.util.NetUtil : -Djava.net.preferIPv6Addresses: false
2022-01-06 09:41:19.012 DEBUG 10 --- [ main] io.netty.util.NetUtil : Loopback interface: lo (lo, 127.0.0.1)
2022-01-06 09:41:19.013 DEBUG 10 --- [ main] io.netty.util.NetUtil : /proc/sys/net/core/somaxconn: 4096
2022-01-06 09:41:19.015 DEBUG 10 --- [ main] io.netty.channel.DefaultChannelId : -Dio.netty.machineId: 26:7f:a7:ff:fe:72:cd:bf (auto-detected)
2022-01-06 09:41:19.061 DEBUG 10 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.allocator.type: pooled
2022-01-06 09:41:19.062 DEBUG 10 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.threadLocalDirectBufferSize: 0
2022-01-06 09:41:19.062 DEBUG 10 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.maxThreadLocalCharBufferSize: 16384
2022-01-06 09:41:19.125 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:41:19.168 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxCapacityPerThread: 4096
2022-01-06 09:41:19.168 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxSharedCapacityFactor: 2
2022-01-06 09:41:19.168 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.linkCapacity: 16
2022-01-06 09:41:19.168 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.ratio: 8
2022-01-06 09:41:19.184 DEBUG 10 --- [er-nio-worker-0] io.netty.buffer.AbstractByteBuf : -Dio.netty.buffer.checkAccessible: true
2022-01-06 09:41:19.184 DEBUG 10 --- [er-nio-worker-0] io.netty.buffer.AbstractByteBuf : -Dio.netty.buffer.checkBounds: true
2022-01-06 09:41:19.184 DEBUG 10 --- [er-nio-worker-0] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@74dd4af0
2022-01-06 09:41:19.255 DEBUG 10 --- [er-nio-worker-0] c.datastax.driver.core.SystemProperties : com.datastax.driver.NATIVE_TRANSPORT_MAX_FRAME_SIZE_IN_MB is undefined, using default value 256
2022-01-06 09:41:19.848 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.71.39:9042] Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:41:19.850 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2022-01-06 09:41:19.946 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema
2022-01-06 09:41:20.177 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2022-01-06 09:41:20.203 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 25 milliseconds
2022-01-06 09:41:20.222 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.233.71.39:9042
2022-01-06 09:41:20.222 INFO 10 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor)
2022-01-06 09:41:20.225 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.233.71.39:9042 added
2022-01-06 09:41:20.225 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.233.68.200:9042 added
2022-01-06 09:41:20.225 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.233.66.95:9042 added
2022-01-06 09:41:20.230 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.CHECK_IO_DEADLOCKS is undefined, using default value true
2022-01-06 09:41:20.235 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.71.39:9042] preparing to open 1 new connections, total = 2
2022-01-06 09:41:20.240 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:41:20.245 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:20.245 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:20.247 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-1, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:41:20.248 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:41:20.249 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-1, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:41:20.250 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 09:41:20.250 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-1, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:41:20.253 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 09:41:20.253 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-1, inFlight=0, closed=true] closing connection
2022-01-06 09:41:20.257 DEBUG 10 --- [luster-worker-0] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:41:20.257 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 09:41:20.258 WARN 10 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Error creating connection to /10.233.68.200:9042
com.datastax.driver.core.exceptions.TransportException: [/10.233.68.200:9042] Cannot connect
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:224)
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:194)
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:577)
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:570)
at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:549)
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:490)
at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:615)
at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:608)
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:321)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:337)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:702)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /10.233.68.200:9042
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:330)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:702)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:41:20.261 WARN 10 --- [er-nio-worker-0] com.datastax.driver.core.Session : Error creating pool to /10.233.68.200:9042
com.datastax.driver.core.exceptions.ConnectionException: [/10.233.68.200:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$6.run(Futures.java:1773)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.google.common.util.concurrent.CollectionFuture$CollectionFutureRunningState.handleAllCompleted(CollectionFuture.java:76)
at com.google.common.util.concurrent.AggregateFuture$RunningState.processCompleted(AggregateFuture.java:255)
at com.google.common.util.concurrent.AggregateFuture$RunningState.decrementCountAndMaybeComplete(AggregateFuture.java:242)
at com.google.common.util.concurrent.AggregateFuture$RunningState.access$300(AggregateFuture.java:91)
at com.google.common.util.concurrent.AggregateFuture$RunningState$1.run(AggregateFuture.java:146)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.completeWithFuture(AbstractFuture.java:730)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:666)
at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:826)
at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:813)
at com.google.common.util.concurrent.Futures$AbstractCatchingFuture.run(Futures.java:789)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.completeWithFuture(AbstractFuture.java:730)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:666)
at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:826)
at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:813)
at com.google.common.util.concurrent.Futures$AbstractCatchingFuture.run(Futures.java:789)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:634)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1405)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:634)
at com.google.common.util.concurrent.SettableFuture.setException(SettableFuture.java:53)
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:222)
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:194)
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:577)
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:570)
at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:549)
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:490)
at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:615)
at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:608)
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:321)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:337)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:702)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:41:21.137 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.71.39:9042] Connection[cassandra/10.233.71.39:9042-2, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:41:21.138 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.233.71.39:9042 (1 connections needed, 1 successfully opened)
2022-01-06 09:41:21.138 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for cassandra/10.233.71.39:9042
2022-01-06 09:41:21.257 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:21.261 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-2, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:41:21.261 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-2, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:41:21.262 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-2, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:41:21.262 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-2, inFlight=0, closed=true] closing connection
2022-01-06 09:41:21.262 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:41:21.263 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 09:41:21.263 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 09:41:22.399 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:41:22.400 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.66.95:9042 (1 connections needed, 1 successfully opened)
2022-01-06 09:41:22.400 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for /10.233.66.95:9042
2022-01-06 09:41:22.874 DEBUG 10 --- [ main] org.reflections.Reflections : going to scan these urls:
file:/opt/app/aai-traversal/resources/
2022-01-06 09:41:22.884 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/query/stored-queries.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.884 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/query/stored-queries.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.885 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.885 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.885 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.885 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.886 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v24/aai_oxm_v24.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.886 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v24/aai_oxm_v24.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.886 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.886 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.887 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.887 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.887 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.887 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.887 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.888 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.888 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.888 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.888 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.888 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.889 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.889 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.890 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.890 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.890 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.891 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.891 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.891 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.891 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.892 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.892 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.892 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.892 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.893 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.893 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.893 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.893 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.894 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.894 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.894 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.894 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.895 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.895 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_pnp_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.895 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_pnp_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.895 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_hpa_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.895 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_hpa_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.895 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_esr_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.896 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_esr_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.896 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_ccvpn_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.896 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_ccvpn_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.896 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_bbs_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.897 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_bbs_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.897 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.897 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.897 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.897 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.898 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.898 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.898 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.898 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.898 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.899 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.899 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.899 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.899 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.899 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.900 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.900 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.900 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.900 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.901 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.901 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.901 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.901 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.902 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.902 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.902 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.902 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.902 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.903 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.903 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.903 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.903 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.904 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.904 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.904 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.904 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.904 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.905 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.905 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.905 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.905 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.905 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.906 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.906 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.906 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.906 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.906 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.907 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.907 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.907 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.907 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.907 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.908 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.908 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.908 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.908 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.908 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.909 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.909 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.909 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.909 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.909 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.910 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.910 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.910 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.910 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.910 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.911 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.911 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.911 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.911 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.911 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.912 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.912 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.912 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.912 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.912 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.913 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.913 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.913 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.913 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.913 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.914 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.914 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.914 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.914 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.915 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.915 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.915 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.915 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.915 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.915 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.916 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.916 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.916 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.916 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.916 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.917 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.917 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.917 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.917 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.917 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.918 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.918 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.918 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.918 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.918 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.919 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.919 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.919 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.919 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.919 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.919 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.920 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.920 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.920 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.920 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.921 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.921 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.921 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.921 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.921 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.921 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.922 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.922 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.922 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.922 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.923 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.923 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.923 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.923 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.923 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.924 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.924 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.924 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.924 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.924 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.925 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.925 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.925 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.925 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.926 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.926 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.926 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.926 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.926 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpn-binding-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.927 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpn-binding-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.927 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpls-pe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.927 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpls-pe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.927 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.927 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.927 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.928 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.928 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.928 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.928 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnfc-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.928 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnfc-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.929 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnf-image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.929 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnf-image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.929 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vlan-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.929 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vlan-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.929 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/virtual-data-center-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.930 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/virtual-data-center-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.930 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vig-server-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.930 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vig-server-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.930 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vf-module-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.930 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vf-module-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.931 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.931 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.931 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/update-node-key-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.931 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/update-node-key-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.931 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tunnel-xconnect-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.931 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tunnel-xconnect-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.932 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tenant-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.932 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tenant-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.932 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tagged-inventory-item-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.932 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tagged-inventory-item-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.932 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/subnet-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.932 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/subnet-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.933 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/start-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.933 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/start-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.933 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/sriov-vf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.933 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/sriov-vf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.933 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/snapshot-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.934 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/snapshot-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.934 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.934 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.934 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.934 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.935 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-subscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.935 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-subscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.935 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.935 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.935 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-capability-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.935 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-capability-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.936 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.936 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.936 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/segmentation-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.936 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/segmentation-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.936 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/secondary-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.936 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/secondary-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.937 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/routing-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.937 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/routing-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.937 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/route-table-reference-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.937 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/route-table-reference-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.937 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/result-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.938 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/result-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.938 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/reserved-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.938 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/reserved-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.938 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/related-lookup-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.939 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/related-lookup-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.939 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.939 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.939 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/property-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.939 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/property-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.939 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/port-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.940 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/port-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.940 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.940 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.940 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/physical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.940 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/physical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.940 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/p-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.941 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/p-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.941 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/oam-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.941 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/oam-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.941 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/newvce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.941 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/newvce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.941 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-profile-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.942 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-profile-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.942 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-policy-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.942 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-policy-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.942 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.942 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.943 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.943 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.943 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/multicast-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.943 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/multicast-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.943 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-ver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.944 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-ver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.944 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.944 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.944 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.944 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.944 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.945 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.945 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/metadatum-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.945 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/metadatum-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.945 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/logical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.945 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/logical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.945 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-key-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.946 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-key-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.946 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.946 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.946 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.946 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.946 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.947 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.947 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.947 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.947 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv6-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.947 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv6-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.948 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv4-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.948 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv4-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.948 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.948 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.948 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/key-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.948 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/key-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.949 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ipsec-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.949 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ipsec-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.949 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.949 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.949 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.950 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.950 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/instance-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.950 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/instance-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.950 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/include-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.950 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/include-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.950 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.951 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.951 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/group-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.951 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/group-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.951 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/generic-vnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.951 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/generic-vnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.952 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/flavor-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.952 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/flavor-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.952 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.952 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.952 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/entitlement-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.953 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/entitlement-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.953 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/element-choice-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.953 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/element-choice-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.953 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/edge-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.953 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/edge-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.953 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/dvs-switch-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.954 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/dvs-switch-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.954 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cvlan-tag-entry-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.954 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cvlan-tag-entry-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.954 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/customer-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.954 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/customer-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.954 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-pool-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.955 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-pool-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.955 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.955 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.955 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/constrained-element-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.955 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/constrained-element-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.955 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/connector-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.956 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/connector-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.956 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.956 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.956 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/complex-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.956 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/complex-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.956 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/collection-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.957 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/collection-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.957 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cloud-region-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.957 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cloud-region-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.957 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/class-of-service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.957 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/class-of-service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.958 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/az-and-dvs-switches-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.958 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/az-and-dvs-switches-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.958 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/availability-zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.958 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/availability-zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.958 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/allotted-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.958 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/allotted-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.959 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.959 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.959 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.959 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.959 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/service-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.960 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/service-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.960 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/resource-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.960 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/resource-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.960 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.960 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.961 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.961 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.961 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getWlBundleId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.961 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getWlBundleId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.961 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.961 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.962 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVnfVlanByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.962 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVnfVlanByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.962 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcSubscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.962 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcSubscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.962 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcInstance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.963 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcInstance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.963 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getSvcSubscriberModelInfo-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.963 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getSvcSubscriberModelInfo-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.963 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.963 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.963 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceModel-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.964 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceModel-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.964 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getRouterRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.964 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getRouterRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.964 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getPinterfacePhysicalLinkBySvcInstId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.964 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getPinterfacePhysicalLinkBySvcInstId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.964 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getLogicalLinkByCloudRegionId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.965 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getLogicalLinkByCloudRegionId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.965 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getL3networkCloudRegionByNetworkRole-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.965 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getL3networkCloudRegionByNetworkRole-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.965 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology2-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.965 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology2-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.965 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.966 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.966 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.966 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.966 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLinkByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.966 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLinkByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.967 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLink-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.967 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLink-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.967 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexLocationId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.967 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexLocationId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.967 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexHostname-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.967 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexHostname-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.968 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.2.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.968 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.2.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.968 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.968 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.968 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.969 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.969 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComplexByPnfName-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.969 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComplexByPnfName-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.969 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getClfiRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.969 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getClfiRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.970 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/closed-loop-named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.970 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/closed-loop-named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.970 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.970 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.970 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.971 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.971 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.971 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.971 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.972 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.972 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.972 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.972 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.972 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.973 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.973 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.973 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.973 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.974 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file cadi.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.974 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file cadi.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.974 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.974 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.974 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file application-keycloak.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.975 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file application-keycloak.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.975 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v2/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.975 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v2/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.976 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v1/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.976 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v1/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.976 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.976 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.977 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.977 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.977 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/permissions.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.977 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/permissions.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.978 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.978 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.978 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.978 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.978 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.979 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.979 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.979 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.980 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.980 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.980 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.980 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.980 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.981 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.981 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.981 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.981 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.981 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.982 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/bath_config.csv in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-01-06 09:41:22.982 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/bath_config.csv in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-01-06 09:41:22.983 INFO 10 --- [ main] org.reflections.Reflections : Reflections took 108 ms to scan 1 urls, producing 0 keys and 0 values
2022-01-06 09:41:23.264 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:23.266 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-3, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:41:23.266 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-3, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:41:23.267 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-3, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:41:23.267 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-3, inFlight=0, closed=true] closing connection
2022-01-06 09:41:23.267 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:41:23.267 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 09:41:23.267 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 09:41:23.891 DEBUG 10 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-2, inFlight=0, closed=true] closing connection
2022-01-06 09:41:23.891 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.71.39:9042] Connection[cassandra/10.233.71.39:9042-2, inFlight=0, closed=true] closed, remaining = 1
2022-01-06 09:41:23.893 DEBUG 10 --- [ main] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-1, inFlight=0, closed=true] closing connection
2022-01-06 09:41:23.893 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-1, inFlight=0, closed=true] closed, remaining = 0
2022-01-06 09:41:23.893 DEBUG 10 --- [ main] com.datastax.driver.core.Cluster : Shutting down
2022-01-06 09:41:23.895 DEBUG 10 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=true] closing connection
2022-01-06 09:41:23.895 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.71.39:9042] Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=true] closed, remaining = 0
2022-01-06 09:41:25.909 DEBUG 10 --- [er-nio-worker-0] io.netty.buffer.PoolThreadCache : Freed 26 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-0
2022-01-06 09:41:25.910 DEBUG 10 --- [er-nio-worker-1] io.netty.buffer.PoolThreadCache : Freed 20 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-1
2022-01-06 09:41:25.929 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2022-01-06 09:41:25.929 INFO 10 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2022-01-06 09:41:25.930 DEBUG 10 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.233.71.39:9042]
2022-01-06 09:41:25.934 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.71.39:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:25.937 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:41:26.147 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.71.39:9042] Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:41:26.148 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2022-01-06 09:41:26.156 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema
2022-01-06 09:41:26.216 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2022-01-06 09:41:26.226 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 10 milliseconds
2022-01-06 09:41:26.240 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.233.71.39:9042
2022-01-06 09:41:26.240 INFO 10 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor)
2022-01-06 09:41:26.240 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.233.71.39:9042 added
2022-01-06 09:41:26.240 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.233.68.200:9042 added
2022-01-06 09:41:26.240 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.233.66.95:9042 added
2022-01-06 09:41:26.240 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.71.39:9042] preparing to open 1 new connections, total = 2
2022-01-06 09:41:26.241 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:26.242 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:26.243 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-1, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:41:26.243 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:41:26.244 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-1, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:41:26.244 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 09:41:26.244 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-1, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:41:26.244 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-1, inFlight=0, closed=true] closing connection
2022-01-06 09:41:26.244 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 09:41:26.244 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:41:26.245 DEBUG 10 --- [luster-worker-0] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:41:26.245 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 09:41:26.245 WARN 10 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Error creating connection to /10.233.68.200:9042
com.datastax.driver.core.exceptions.TransportException: [/10.233.68.200:9042] Cannot connect
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:224)
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:194)
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:577)
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:570)
at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:549)
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:490)
at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:615)
at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:608)
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:321)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:337)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:702)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /10.233.68.200:9042
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:330)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:702)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:41:26.246 WARN 10 --- [er-nio-worker-0] com.datastax.driver.core.Session : Error creating pool to /10.233.68.200:9042
com.datastax.driver.core.exceptions.ConnectionException: [/10.233.68.200:9042] Pool was closed during initialization
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173)
at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158)
at com.google.common.util.concurrent.Futures$6.run(Futures.java:1773)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.google.common.util.concurrent.CollectionFuture$CollectionFutureRunningState.handleAllCompleted(CollectionFuture.java:76)
at com.google.common.util.concurrent.AggregateFuture$RunningState.processCompleted(AggregateFuture.java:255)
at com.google.common.util.concurrent.AggregateFuture$RunningState.decrementCountAndMaybeComplete(AggregateFuture.java:242)
at com.google.common.util.concurrent.AggregateFuture$RunningState.access$300(AggregateFuture.java:91)
at com.google.common.util.concurrent.AggregateFuture$RunningState$1.run(AggregateFuture.java:146)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.completeWithFuture(AbstractFuture.java:730)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:666)
at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:826)
at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:813)
at com.google.common.util.concurrent.Futures$AbstractCatchingFuture.run(Futures.java:789)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.completeWithFuture(AbstractFuture.java:730)
at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:666)
at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:826)
at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:813)
at com.google.common.util.concurrent.Futures$AbstractCatchingFuture.run(Futures.java:789)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:634)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1405)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:634)
at com.google.common.util.concurrent.SettableFuture.setException(SettableFuture.java:53)
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:222)
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:194)
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:577)
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:570)
at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:549)
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:490)
at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:615)
at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:608)
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:321)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:337)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:702)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:41:26.458 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.71.39:9042] Connection[cassandra/10.233.71.39:9042-2, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:41:26.458 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.233.71.39:9042 (1 connections needed, 1 successfully opened)
2022-01-06 09:41:26.458 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for cassandra/10.233.71.39:9042
2022-01-06 09:41:27.245 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:27.249 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-2, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:41:27.249 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-2, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:41:27.250 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-2, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:41:27.250 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-2, inFlight=0, closed=true] closing connection
2022-01-06 09:41:27.250 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:41:27.250 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 09:41:27.251 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 09:41:28.251 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 09:41:28.254 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 09:41:28.785 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:41:28.786 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.66.95:9042 (1 connections needed, 1 successfully opened)
2022-01-06 09:41:28.786 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for /10.233.66.95:9042
2022-01-06 09:41:29.252 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:29.254 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-3, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:41:29.258 DEBUG 10 --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 09:41:29.263 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 09:41:29.263 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 09:41:29.263 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Cluster : Preparing 16 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 09:41:29.263 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 2
2022-01-06 09:41:29.266 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-4, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:41:31.689 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Processing the translator
2022-01-06 09:41:31.691 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv11
2022-01-06 09:41:31.691 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.697 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v11, BODY=
2022-01-06 09:41:31.699 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.699 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.699 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.699 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.711 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.713 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.713 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.714 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv12
2022-01-06 09:41:31.714 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.714 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v12, BODY=
2022-01-06 09:41:31.716 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.716 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.716 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.716 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.726 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.728 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.728 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.729 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv13
2022-01-06 09:41:31.729 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.729 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v13, BODY=
2022-01-06 09:41:31.731 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.731 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.731 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.731 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.744 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.746 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.746 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.746 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv14
2022-01-06 09:41:31.747 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.747 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v14, BODY=
2022-01-06 09:41:31.748 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.748 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.748 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.748 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.759 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.761 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.761 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.762 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv15
2022-01-06 09:41:31.762 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.763 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v15, BODY=
2022-01-06 09:41:31.764 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.764 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.764 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.764 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.774 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.777 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.777 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.777 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv16
2022-01-06 09:41:31.778 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.778 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v16, BODY=
2022-01-06 09:41:31.779 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.779 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.779 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.779 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.791 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.793 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.794 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.794 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv17
2022-01-06 09:41:31.794 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.795 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v17, BODY=
2022-01-06 09:41:31.796 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.796 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.796 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.796 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.809 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.811 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.812 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.812 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv18
2022-01-06 09:41:31.812 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.813 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v18, BODY=
2022-01-06 09:41:31.814 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.814 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.814 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.814 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.825 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.828 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.828 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.828 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv19
2022-01-06 09:41:31.829 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.830 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v19, BODY=
2022-01-06 09:41:31.831 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.831 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.831 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.831 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.841 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.844 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.844 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.844 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv20
2022-01-06 09:41:31.845 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.845 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v20, BODY=
2022-01-06 09:41:31.847 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.847 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.847 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.847 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.859 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.862 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.862 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.863 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv21
2022-01-06 09:41:31.863 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.864 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v21, BODY=
2022-01-06 09:41:31.865 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.865 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.865 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.865 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.877 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.883 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.883 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.884 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv22
2022-01-06 09:41:31.884 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.885 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v22, BODY=
2022-01-06 09:41:31.886 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.886 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.886 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.886 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.901 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.906 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.907 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.907 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv23
2022-01-06 09:41:31.907 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.908 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v23, BODY=
2022-01-06 09:41:31.910 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.910 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.910 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.910 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.923 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.929 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.930 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:31.930 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv24
2022-01-06 09:41:31.931 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:31.931 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v24, BODY=
2022-01-06 09:41:31.933 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:31.933 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:31.933 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:31.933 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:31.947 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:31.952 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-01-06 09:41:31.953 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-01-06 09:41:32.079 INFO 10 --- [ main] o.o.a.rest.search.SchemaServiceCQConfig : Calling the SchemaService to retrieve stored queries
2022-01-06 09:41:32.079 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-01-06 09:41:32.080 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/stored-queries, BODY=
2022-01-06 09:41:32.082 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-01-06 09:41:32.082 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-01-06 09:41:32.082 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-01-06 09:41:32.082 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-01-06 09:41:32.099 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-01-06 09:41:33.098 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Found javax.persistence.Persistence on classpath containing 'getPersistenceUtil'. Assuming JPA 2 environment. Trying to instantiate JPA aware TraversableResolver
2022-01-06 09:41:33.098 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Instantiated JPA aware TraversableResolver of type org.hibernate.validator.internal.engine.resolver.JPATraversableResolver.
2022-01-06 09:41:33.099 DEBUG 10 --- [ main] .h.v.m.ResourceBundleMessageInterpolator : Loaded expression factory via original TCCL
2022-01-06 09:41:33.101 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Found javax.persistence.Persistence on classpath containing 'getPersistenceUtil'. Assuming JPA 2 environment. Trying to instantiate JPA aware TraversableResolver
2022-01-06 09:41:33.101 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Instantiated JPA aware TraversableResolver of type org.hibernate.validator.internal.engine.resolver.JPATraversableResolver.
2022-01-06 09:41:33.102 DEBUG 10 --- [ main] o.h.v.internal.engine.ConfigurationImpl : Setting custom MessageInterpolator of type org.springframework.validation.beanvalidation.LocaleContextMessageInterpolator
2022-01-06 09:41:33.103 DEBUG 10 --- [ main] o.h.v.internal.engine.ConfigurationImpl : Setting custom ConstraintValidatorFactory of type org.springframework.validation.beanvalidation.SpringConstraintValidatorFactory
2022-01-06 09:41:33.104 DEBUG 10 --- [ main] o.h.v.internal.engine.ConfigurationImpl : Setting custom ParameterNameProvider of type org.springframework.validation.beanvalidation.LocalValidatorFactoryBean$1
2022-01-06 09:41:33.105 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : Trying to load META-INF/validation.xml for XML based Validator configuration.
2022-01-06 09:41:33.105 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via user class loader
2022-01-06 09:41:33.106 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via TCCL
2022-01-06 09:41:33.106 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via Hibernate Validator's class loader
2022-01-06 09:41:33.107 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : No META-INF/validation.xml found. Using annotation based configuration only.
2022-01-06 09:41:33.120 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.springframework.validation.beanvalidation.LocaleContextMessageInterpolator as ValidatorFactory-scoped message interpolator.
2022-01-06 09:41:33.120 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.resolver.JPATraversableResolver as ValidatorFactory-scoped traversable resolver.
2022-01-06 09:41:33.120 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.util.ExecutableParameterNameProvider as ValidatorFactory-scoped parameter name provider.
2022-01-06 09:41:33.120 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.DefaultClockProvider as ValidatorFactory-scoped clock provider.
2022-01-06 09:41:33.120 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.scripting.DefaultScriptEvaluatorFactory as ValidatorFactory-scoped script evaluator factory.
2022-01-06 09:41:33.668 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2022-01-06 09:41:33.668 INFO 10 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2022-01-06 09:41:33.679 WARN 10 --- [ main] .b.a.g.t.GroovyTemplateAutoConfiguration : Cannot find template location: classpath:/templates/ (please add some templates, check your Groovy configuration, or set spring.groovy.template.check-template-location=false)
2022-01-06 09:41:35.541 DEBUG 10 --- [ main] i.m.s.web.servlet.WebMvcMetricsFilter : Filter 'webMetricsFilter' configured for use
2022-01-06 09:41:37.039 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Found javax.persistence.Persistence on classpath containing 'getPersistenceUtil'. Assuming JPA 2 environment. Trying to instantiate JPA aware TraversableResolver
2022-01-06 09:41:37.040 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Instantiated JPA aware TraversableResolver of type org.hibernate.validator.internal.engine.resolver.JPATraversableResolver.
2022-01-06 09:41:37.041 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : Trying to load META-INF/validation.xml for XML based Validator configuration.
2022-01-06 09:41:37.041 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via TCCL
2022-01-06 09:41:37.042 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via Hibernate Validator's class loader
2022-01-06 09:41:37.043 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : No META-INF/validation.xml found. Using annotation based configuration only.
2022-01-06 09:41:37.059 DEBUG 10 --- [ main] .h.v.m.ResourceBundleMessageInterpolator : Loaded expression factory via original TCCL
2022-01-06 09:41:37.059 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.messageinterpolation.ResourceBundleMessageInterpolator as ValidatorFactory-scoped message interpolator.
2022-01-06 09:41:37.059 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.resolver.JPATraversableResolver as ValidatorFactory-scoped traversable resolver.
2022-01-06 09:41:37.060 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.util.ExecutableParameterNameProvider as ValidatorFactory-scoped parameter name provider.
2022-01-06 09:41:37.060 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.DefaultClockProvider as ValidatorFactory-scoped clock provider.
2022-01-06 09:41:37.060 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.scripting.DefaultScriptEvaluatorFactory as ValidatorFactory-scoped script evaluator factory.
2022-01-06 09:41:37.222 WARN 10 --- [ main] org.glassfish.jersey.internal.Errors : The following warnings have been detected: WARNING: The (sub)resource method getC2Qgremlin in org.onap.aai.rest.CQ2Gremlin contains empty path annotation.
WARNING: The (sub)resource method getC2Qgremlin in org.onap.aai.rest.CQ2GremlinTest contains empty path annotation.
WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.onap.aai.rest.RecentAPIConsumer.getRecentData(java.lang.String,java.lang.String,java.lang.String,javax.ws.rs.core.HttpHeaders,javax.servlet.http.HttpServletRequest,javax.ws.rs.core.UriInfo), should not consume any entity.
2022-01-06 09:41:37.230 DEBUG 10 --- [ main] org.onap.aai.config.ErrorHandler : Filter 'errorHandler' configured for use
2022-01-06 09:41:38.046 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-4, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:41:38.046 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-3, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:41:38.046 DEBUG 10 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 09:41:38.051 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Successful reconnection to /10.233.68.200:9042, setting host UP
2022-01-06 09:41:38.450 INFO 10 --- [ main] org.onap.aai.TraversalApp : Application 'aai-traversal' is running on 8446!
2022-01-06 09:41:38.450 DEBUG 10 --- [ main] org.onap.aai.TraversalApp : Traversal MicroService Started
Traversal Microservice Started
2022-01-06 09:41:38.559 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 0 new connections, total = 2
2022-01-06 09:41:38.560 DEBUG 10 --- [luster-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 1 successfully opened)
2022-01-06 09:41:38.560 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 09:41:38.561 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-3, inFlight=0, closed=true] closing connection
2022-01-06 09:41:38.562 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-3, inFlight=0, closed=true] closed, remaining = 1
2022-01-06 09:41:38.562 DEBUG 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2022-01-06 09:41:40.095 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-1, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:41:40.096 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-1, inFlight=0, closed=false] because: [/10.233.66.95:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 09:41:40.096 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preventing new connections for the next 1000 ms
2022-01-06 09:41:40.096 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-1, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:41:40.096 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-1, inFlight=0, closed=true] closing connection
2022-01-06 09:41:40.096 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] marking host DOWN
2022-01-06 09:41:40.097 DEBUG 10 --- [luster-worker-1] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:41:40.097 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] starting reconnection attempt
2022-01-06 09:41:40.237 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.66.95:9042, scheduling delivery
2022-01-06 09:41:40.237 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] received event DOWN
2022-01-06 09:41:41.097 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:41.101 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-2, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:41:41.101 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-2, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:41:41.101 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-2, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:41:41.101 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-2, inFlight=0, closed=true] closing connection
2022-01-06 09:41:41.102 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:41:41.102 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 09:41:41.102 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 2000 ms
2022-01-06 09:41:41.238 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:41:43.102 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:43.105 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-3, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:41:43.106 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-3, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:41:43.106 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-3, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:41:43.106 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-3, inFlight=0, closed=true] closing connection
2022-01-06 09:41:43.106 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:41:43.107 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 09:41:43.107 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 4000 ms
2022-01-06 09:41:47.107 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:47.112 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-4, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:41:47.113 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-4, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:41:47.113 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-4, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:41:47.113 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-4, inFlight=0, closed=true] closing connection
2022-01-06 09:41:47.113 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:41:47.114 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 09:41:47.114 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 8000 ms
2022-01-06 09:41:55.114 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:41:55.120 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-5, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:41:55.120 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-5, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:41:55.120 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-5, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:41:55.120 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-5, inFlight=0, closed=true] closing connection
2022-01-06 09:41:55.120 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:41:55.121 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 09:41:55.121 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 16000 ms
2022-01-06 09:42:05.266 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-4, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:42:05.266 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-4, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 09:42:05.266 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 09:42:05.266 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-4, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:42:05.267 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-4, inFlight=0, closed=true] closing connection
2022-01-06 09:42:05.267 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 09:42:05.267 DEBUG 10 --- [luster-worker-1] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:42:05.267 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 09:42:05.368 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 09:42:05.369 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 09:42:06.267 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:42:06.270 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-5, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:42:06.270 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-5, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:42:06.270 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-5, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:42:06.270 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-5, inFlight=0, closed=true] closing connection
2022-01-06 09:42:06.270 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:42:06.271 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 09:42:06.271 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 09:42:06.369 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:42:07.169 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1684354549-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@254ebb3f at consistency null
2022-01-06 09:42:07.169 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1684354549-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:07.213 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1321068674-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@79571818 at consistency null
2022-01-06 09:42:07.214 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1321068674-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:07.242 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [797455736-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@299f1fe1 at consistency null
2022-01-06 09:42:07.242 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [797455736-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:07.295 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1811003445-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2c5fca1 at consistency null
2022-01-06 09:42:07.295 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1811003445-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:07.348 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1769672026-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@52022885 at consistency null
2022-01-06 09:42:07.348 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1769672026-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:07.401 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1210257679-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@13546d05 at consistency null
2022-01-06 09:42:07.401 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1210257679-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:07.455 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [653184646-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@42e50899 at consistency null
2022-01-06 09:42:07.455 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [653184646-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:07.560 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1077475966-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6fe8d490 at consistency null
2022-01-06 09:42:07.560 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1077475966-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:07.765 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1897414398-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2ced9fe8 at consistency null
2022-01-06 09:42:07.766 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1897414398-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:08.169 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [568586939-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1ce1e335 at consistency null
2022-01-06 09:42:08.170 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [568586939-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:08.271 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:42:08.274 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-6, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:42:08.274 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-6, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:42:08.274 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-6, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:42:08.274 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:42:08.274 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-6, inFlight=0, closed=true] closing connection
2022-01-06 09:42:08.275 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 09:42:08.275 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 09:42:08.591 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1906938623-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@762a81f0 at consistency null
2022-01-06 09:42:08.591 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1906938623-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:09.401 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1992650174-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5f4f97f1 at consistency null
2022-01-06 09:42:09.401 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1992650174-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:11.006 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1184514646-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1f1d512f at consistency null
2022-01-06 09:42:11.007 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1184514646-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:11.008 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:42:01.655Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:42:11.121 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:42:11.123 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-6, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:42:11.123 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-6, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:42:11.124 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-6, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:42:11.124 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-6, inFlight=0, closed=true] closing connection
2022-01-06 09:42:11.124 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:42:11.124 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 09:42:11.124 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 32000 ms
2022-01-06 09:42:12.275 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:42:12.278 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-7, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:42:12.278 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-7, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:42:12.278 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-7, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:42:12.279 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-7, inFlight=0, closed=true] closing connection
2022-01-06 09:42:12.279 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:42:12.279 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 09:42:12.279 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 09:42:16.017 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2027030036-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@d222eed at consistency null
2022-01-06 09:42:16.017 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2027030036-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:16.046 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1162956187-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7843924f at consistency null
2022-01-06 09:42:16.046 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1162956187-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:16.100 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [413429778-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@43030784 at consistency null
2022-01-06 09:42:16.101 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [413429778-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:16.204 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [204999074-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6374f415 at consistency null
2022-01-06 09:42:16.205 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [204999074-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:16.309 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1689406615-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7f3dfbd0 at consistency null
2022-01-06 09:42:16.309 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1689406615-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:16.516 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [725673999-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1b08df92 at consistency null
2022-01-06 09:42:16.517 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [725673999-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:16.737 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [274676117-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@406cc450 at consistency null
2022-01-06 09:42:16.737 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [274676117-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:16.941 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1558595365-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4fc4414 at consistency null
2022-01-06 09:42:16.941 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1558595365-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:17.145 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [717647578-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@140fdc20 at consistency null
2022-01-06 09:42:17.145 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [717647578-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:17.350 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [107670301-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@49a6657c at consistency null
2022-01-06 09:42:17.350 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [107670301-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:17.757 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1871768020-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6fce665c at consistency null
2022-01-06 09:42:17.757 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1871768020-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:18.561 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [18961516-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@9f45355 at consistency null
2022-01-06 09:42:18.561 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [18961516-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:19.364 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [403200556-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@63707097 at consistency null
2022-01-06 09:42:19.365 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [403200556-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:19.366 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:42:01.655Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:42:20.279 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:42:20.282 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-8, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:42:20.282 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-8, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:42:20.282 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-8, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:42:20.282 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-8, inFlight=0, closed=true] closing connection
2022-01-06 09:42:20.282 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:42:20.283 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 09:42:20.283 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 09:42:24.437 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1231779891-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@19876400 at consistency null
2022-01-06 09:42:24.437 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1231779891-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:24.537 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [559806083-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5670dea at consistency null
2022-01-06 09:42:24.537 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [559806083-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:24.637 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [718554352-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2e2288e8 at consistency null
2022-01-06 09:42:24.637 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [718554352-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:24.739 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1893180092-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4eb6a173 at consistency null
2022-01-06 09:42:24.739 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1893180092-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:24.767 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1659893365-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6cb37bc1 at consistency null
2022-01-06 09:42:24.767 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1659893365-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:24.836 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [751369541-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@510623e0 at consistency null
2022-01-06 09:42:24.836 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [751369541-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:24.940 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [615768040-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6bd994e0 at consistency null
2022-01-06 09:42:24.940 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [615768040-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:25.045 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1765563264-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@101f1dd1 at consistency null
2022-01-06 09:42:25.045 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1765563264-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:25.148 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1954370700-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@67850160 at consistency null
2022-01-06 09:42:25.148 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1954370700-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:25.251 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [531934611-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@77c2753 at consistency null
2022-01-06 09:42:25.252 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [531934611-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:25.455 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [625110290-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@20a5cdc8 at consistency null
2022-01-06 09:42:25.456 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [625110290-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:25.860 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [774492769-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@48bcbd98 at consistency null
2022-01-06 09:42:25.860 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [774492769-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:26.664 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [812526108-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7fd3bee at consistency null
2022-01-06 09:42:26.664 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [812526108-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:28.268 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [176996791-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@615dd2fd at consistency null
2022-01-06 09:42:28.268 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [176996791-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:28.269 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:42:01.655Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:42:33.273 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1016076041-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6f189893 at consistency null
2022-01-06 09:42:33.273 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1016076041-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:33.327 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1556770848-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@42e5a895 at consistency null
2022-01-06 09:42:33.327 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1556770848-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:33.382 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [498442095-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2ca9c96c at consistency null
2022-01-06 09:42:33.382 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [498442095-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:33.437 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1901622295-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@23ec3c3e at consistency null
2022-01-06 09:42:33.437 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1901622295-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:33.542 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1305222506-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@81bf4d0 at consistency null
2022-01-06 09:42:33.542 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1305222506-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:33.746 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1107832707-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@67d54446 at consistency null
2022-01-06 09:42:33.746 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1107832707-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:33.950 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1937219146-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5551379 at consistency null
2022-01-06 09:42:33.950 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1937219146-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:34.154 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1102951679-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@479ac221 at consistency null
2022-01-06 09:42:34.154 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1102951679-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:34.558 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1823983343-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@10700376 at consistency null
2022-01-06 09:42:34.558 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1823983343-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:34.963 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1866504397-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5dca824a at consistency null
2022-01-06 09:42:34.963 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1866504397-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:35.399 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:42:35.401 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:42:35.766 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [545971873-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@70299c51 at consistency null
2022-01-06 09:42:35.767 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [545971873-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:36.283 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:42:36.286 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-9, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:42:36.286 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-9, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:42:36.286 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-9, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:42:36.286 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-9, inFlight=0, closed=true] closing connection
2022-01-06 09:42:36.286 DEBUG 10 --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:42:36.287 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 09:42:36.287 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 09:42:36.571 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [213683203-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6133d3bf at consistency null
2022-01-06 09:42:36.571 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [213683203-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:36.572 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:42:01.655Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:42:41.576 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1584313285-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@71c8175c at consistency null
2022-01-06 09:42:41.577 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1584313285-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:41.637 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [897830453-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@781913fd at consistency null
2022-01-06 09:42:41.638 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [897830453-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:41.737 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1133142514-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@44eec3bb at consistency null
2022-01-06 09:42:41.737 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1133142514-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:41.841 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [733880596-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3b3f4eb2 at consistency null
2022-01-06 09:42:41.841 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [733880596-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:42.044 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [6643517-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@a7ccc7e at consistency null
2022-01-06 09:42:42.044 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [6643517-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:42.248 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [733797218-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3a4ab037 at consistency null
2022-01-06 09:42:42.248 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [733797218-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:42.452 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [992590358-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@88b4fde at consistency null
2022-01-06 09:42:42.452 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [992590358-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:42.856 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1640340198-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4900caa3 at consistency null
2022-01-06 09:42:42.856 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1640340198-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:43.124 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:42:43.127 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-7, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:42:43.128 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-7, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:42:43.128 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-7, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:42:43.128 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-7, inFlight=0, closed=true] closing connection
2022-01-06 09:42:43.128 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:42:43.128 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 09:42:43.128 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 64000 ms
2022-01-06 09:42:43.660 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1274260820-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@25f3e0c1 at consistency null
2022-01-06 09:42:43.661 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1274260820-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:44.465 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [114886787-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4ad73740 at consistency null
2022-01-06 09:42:44.465 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [114886787-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:45.270 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1893137220-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@18f0747b at consistency null
2022-01-06 09:42:45.270 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1893137220-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:45.271 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:42:01.655Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:42:50.275 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1024023826-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@57eae014 at consistency null
2022-01-06 09:42:50.276 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1024023826-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:50.304 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1799802602-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6d25e7c0 at consistency null
2022-01-06 09:42:50.304 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1799802602-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:50.333 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [622157329-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1ebba013 at consistency null
2022-01-06 09:42:50.333 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [622157329-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:50.362 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1650363692-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5f35c13 at consistency null
2022-01-06 09:42:50.362 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1650363692-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:50.415 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [365473208-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@599f6f9 at consistency null
2022-01-06 09:42:50.415 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [365473208-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:50.469 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1210318965-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@47401a6d at consistency null
2022-01-06 09:42:50.469 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1210318965-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:50.523 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1196305078-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@43891ae at consistency null
2022-01-06 09:42:50.523 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1196305078-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:50.577 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1374681246-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1bb456fe at consistency null
2022-01-06 09:42:50.577 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1374681246-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:50.631 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [18492022-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@51d0454f at consistency null
2022-01-06 09:42:50.631 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [18492022-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:50.735 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1775613320-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1604ae6a at consistency null
2022-01-06 09:42:50.735 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1775613320-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:50.939 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1610103198-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@56f1f8e5 at consistency null
2022-01-06 09:42:50.939 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1610103198-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:51.143 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1904022007-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6f4b5763 at consistency null
2022-01-06 09:42:51.143 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1904022007-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:51.547 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [560258100-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3c628df8 at consistency null
2022-01-06 09:42:51.547 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [560258100-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:42:52.351 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1708737637-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@f2603e0 at consistency null
2022-01-06 09:42:52.351 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1708737637-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:43:05.423 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:43:05.426 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:43:06.351 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.66.95:9042, scheduling delivery
2022-01-06 09:43:06.352 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] received event UP
2022-01-06 09:43:07.353 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.66.95:9042
2022-01-06 09:43:07.364 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] marking host UP
2022-01-06 09:43:07.364 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 09:43:07.364 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.66.95:9042
2022-01-06 09:43:07.364 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:43:07.367 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-8, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:43:08.287 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:43:08.290 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-10, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:43:08.290 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-10, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:43:08.290 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-10, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:43:08.290 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-10, inFlight=0, closed=true] closing connection
2022-01-06 09:43:08.290 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:43:08.291 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 09:43:08.291 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 09:43:08.708 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-8, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:43:09.191 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 0 new connections, total = 1
2022-01-06 09:43:09.192 DEBUG 10 --- [luster-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.66.95:9042 (1 connections needed, 1 successfully opened)
2022-01-06 09:43:09.192 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.233.66.95:9042
2022-01-06 09:43:13.518 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED KEYSPACE dox, scheduling delivery
2022-01-06 09:43:14.355 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 09:43:14.355 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 09:43:14.526 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox
2022-01-06 09:43:14.532 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2022-01-06 09:43:14.550 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 18 milliseconds
2022-01-06 09:43:15.357 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 09:43:15.361 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 09:43:15.361 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 09:43:15.361 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 09:43:15.361 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:43:15.363 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-11, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:43:17.840 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED KEYSPACE zusammen_dox, scheduling delivery
2022-01-06 09:43:18.647 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-11, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:43:18.841 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox
2022-01-06 09:43:18.847 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2022-01-06 09:43:18.855 DEBUG 10 --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 8 milliseconds
2022-01-06 09:43:18.968 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 0 new connections, total = 1
2022-01-06 09:43:18.968 DEBUG 10 --- [luster-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 1 successfully opened)
2022-01-06 09:43:18.968 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 09:43:28.513 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TYPE dox.version, scheduling delivery
2022-01-06 09:43:29.514 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.version (TYPE)
2022-01-06 09:43:31.603 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TYPE dox.user_candidate_version, scheduling delivery
2022-01-06 09:43:32.604 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.user_candidate_version (TYPE)
2022-01-06 09:43:33.737 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.version_info, scheduling delivery
2022-01-06 09:43:34.738 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.version_info (TABLE)
2022-01-06 09:43:36.451 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.version_info_deleted, scheduling delivery
2022-01-06 09:43:37.451 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.version_info_deleted (TABLE)
2022-01-06 09:43:39.454 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.unique_value, scheduling delivery
2022-01-06 09:43:40.455 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.unique_value (TABLE)
2022-01-06 09:43:43.038 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.package_details, scheduling delivery
2022-01-06 09:43:44.038 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.package_details (TABLE)
2022-01-06 09:43:45.538 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_enriched_service_template, scheduling delivery
2022-01-06 09:43:45.653 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-11, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:43:45.654 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-11, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 09:43:45.654 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 09:43:45.654 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-11, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:43:45.654 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-11, inFlight=0, closed=true] closing connection
2022-01-06 09:43:45.654 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 09:43:45.655 DEBUG 10 --- [luster-worker-1] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:43:45.655 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 09:43:45.739 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 09:43:45.739 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 09:43:46.539 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.vsp_enriched_service_template (TABLE)
2022-01-06 09:43:46.554 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_enriched_service_artifact, scheduling delivery
2022-01-06 09:43:46.655 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:43:46.657 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-12, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:43:46.658 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-12, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:43:46.658 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-12, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:43:46.658 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-12, inFlight=0, closed=true] closing connection
2022-01-06 09:43:46.658 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:43:46.658 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 09:43:46.658 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 09:43:46.740 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:43:47.554 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.vsp_enriched_service_artifact (TABLE)
2022-01-06 09:43:48.099 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.application_config, scheduling delivery
2022-01-06 09:43:48.659 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:43:48.661 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-13, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:43:48.662 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-13, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:43:48.662 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-13, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:43:48.662 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-13, inFlight=0, closed=true] closing connection
2022-01-06 09:43:48.662 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:43:48.662 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 09:43:48.662 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 09:43:49.099 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.application_config (TABLE)
2022-01-06 09:43:49.886 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.action, scheduling delivery
2022-01-06 09:43:50.886 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2022-01-06 09:43:51.983 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2022-01-06 09:43:52.663 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:43:52.665 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-14, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:43:52.666 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-14, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:43:52.666 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-14, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:43:52.666 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:43:52.666 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-14, inFlight=0, closed=true] closing connection
2022-01-06 09:43:52.667 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 09:43:52.667 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 09:43:52.983 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2022-01-06 09:43:54.041 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2022-01-06 09:43:55.042 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2022-01-06 09:43:55.983 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2022-01-06 09:43:56.983 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2022-01-06 09:43:58.845 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2022-01-06 09:43:59.845 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2022-01-06 09:44:00.667 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:44:00.669 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-15, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:44:00.670 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-15, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:44:00.670 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-15, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:44:00.670 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-15, inFlight=0, closed=true] closing connection
2022-01-06 09:44:00.670 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:44:00.670 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 09:44:00.670 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 09:44:01.438 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2022-01-06 09:44:02.439 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2022-01-06 09:44:03.462 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.ecompcomponent, scheduling delivery
2022-01-06 09:44:04.463 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.ecompcomponent (TABLE)
2022-01-06 09:44:06.480 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE dox.action, scheduling delivery
2022-01-06 09:44:07.480 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action (TABLE)
2022-01-06 09:44:08.338 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.action_artifact, scheduling delivery
2022-01-06 09:44:09.339 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.action_artifact (TABLE)
2022-01-06 09:44:09.531 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.activity_log, scheduling delivery
2022-01-06 09:44:10.531 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.activity_log (TABLE)
2022-01-06 09:44:11.224 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.healing, scheduling delivery
2022-01-06 09:44:12.225 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.healing (TABLE)
2022-01-06 09:44:13.610 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.migration, scheduling delivery
2022-01-06 09:44:14.610 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.migration (TABLE)
2022-01-06 09:44:15.960 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.item_permissions, scheduling delivery
2022-01-06 09:44:16.670 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:44:16.673 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-16, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:44:16.673 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-16, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:44:16.673 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-16, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:44:16.673 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-16, inFlight=0, closed=true] closing connection
2022-01-06 09:44:16.673 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:44:16.673 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 09:44:16.673 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 09:44:16.960 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.item_permissions (TABLE)
2022-01-06 09:44:20.651 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.user_permission_items, scheduling delivery
2022-01-06 09:44:21.652 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.user_permission_items (TABLE)
2022-01-06 09:44:23.638 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.notification_subscribers, scheduling delivery
2022-01-06 09:44:24.639 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.notification_subscribers (TABLE)
2022-01-06 09:44:25.846 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.last_notification, scheduling delivery
2022-01-06 09:44:26.846 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.last_notification (TABLE)
2022-01-06 09:44:28.084 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.notifications, scheduling delivery
2022-01-06 09:44:29.085 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.notifications (TABLE)
2022-01-06 09:44:30.191 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE dox.vsp_merge_hint, scheduling delivery
2022-01-06 09:44:31.193 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for dox.vsp_merge_hint (TABLE)
2022-01-06 09:44:33.506 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.item, scheduling delivery
2022-01-06 09:44:34.507 DEBUG 10 --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.item (TABLE)
2022-01-06 09:44:35.978 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version, scheduling delivery
2022-01-06 09:44:36.978 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox.version (TABLE)
2022-01-06 09:44:40.006 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-8, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:44:40.007 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-8, inFlight=0, closed=false] because: [/10.233.66.95:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 09:44:40.007 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preventing new connections for the next 1000 ms
2022-01-06 09:44:40.007 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-8, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:44:40.007 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-8, inFlight=0, closed=true] closing connection
2022-01-06 09:44:40.007 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] marking host DOWN
2022-01-06 09:44:40.008 DEBUG 10 --- [luster-worker-1] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:44:40.008 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] starting reconnection attempt
2022-01-06 09:44:40.140 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.66.95:9042, scheduling delivery
2022-01-06 09:44:40.140 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] received event DOWN
2022-01-06 09:44:41.008 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:44:41.017 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-9, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:44:41.017 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-9, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:44:41.017 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-9, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:44:41.017 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-9, inFlight=0, closed=true] closing connection
2022-01-06 09:44:41.018 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:44:41.018 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 09:44:41.018 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 2000 ms
2022-01-06 09:44:41.141 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:44:43.018 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:44:43.021 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-10, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:44:43.021 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-10, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:44:43.021 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-10, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:44:43.021 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-10, inFlight=0, closed=true] closing connection
2022-01-06 09:44:43.022 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:44:43.022 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 09:44:43.022 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 4000 ms
2022-01-06 09:44:44.639 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [162344779-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6f9f9bc6 at consistency null
2022-01-06 09:44:44.639 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [162344779-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:44.739 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2071689194-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@62c9532d at consistency null
2022-01-06 09:44:44.740 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2071689194-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:44.839 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [327485003-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7aad776e at consistency null
2022-01-06 09:44:44.839 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [327485003-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:44.939 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1330820540-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7ca42d31 at consistency null
2022-01-06 09:44:44.939 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1330820540-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:45.039 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [803544170-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6ff6d8c8 at consistency null
2022-01-06 09:44:45.039 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [803544170-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:45.143 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [260176475-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@470eae20 at consistency null
2022-01-06 09:44:45.143 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [260176475-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:45.246 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [881656510-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5689b7a8 at consistency null
2022-01-06 09:44:45.246 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [881656510-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:45.449 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1856548550-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@b99c5ed at consistency null
2022-01-06 09:44:45.449 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1856548550-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:45.653 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1772747061-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@52f06cce at consistency null
2022-01-06 09:44:45.653 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1772747061-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:45.857 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1769641337-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@60bdb71e at consistency null
2022-01-06 09:44:45.857 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1769641337-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:46.263 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [901706266-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7b127856 at consistency null
2022-01-06 09:44:46.263 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [901706266-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:47.022 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:44:47.025 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-11, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:44:47.025 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-11, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:44:47.025 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-11, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:44:47.025 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-11, inFlight=0, closed=true] closing connection
2022-01-06 09:44:47.026 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:44:47.026 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 09:44:47.026 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 8000 ms
2022-01-06 09:44:47.067 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [516666613-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@62aeaed7 at consistency null
2022-01-06 09:44:47.067 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [516666613-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:47.870 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [940414536-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@a16ba1c at consistency null
2022-01-06 09:44:47.870 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [940414536-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:47.872 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:44:38.989Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:44:48.674 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:44:48.676 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-17, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:44:48.676 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-17, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:44:48.676 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-17, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:44:48.676 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-17, inFlight=0, closed=true] closing connection
2022-01-06 09:44:48.676 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:44:48.677 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 09:44:48.677 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 09:44:52.876 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [90250605-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3fa1e5f6 at consistency null
2022-01-06 09:44:52.876 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [90250605-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:52.929 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1200423417-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@67d4eec9 at consistency null
2022-01-06 09:44:52.929 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1200423417-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:53.033 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [69368289-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@701b3cf2 at consistency null
2022-01-06 09:44:53.033 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [69368289-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:53.236 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1355350267-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f62beb7 at consistency null
2022-01-06 09:44:53.237 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1355350267-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:53.441 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1573840378-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7fdc6cf8 at consistency null
2022-01-06 09:44:53.441 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1573840378-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:53.845 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1919133043-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f3e676c at consistency null
2022-01-06 09:44:53.845 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1919133043-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:54.251 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1696151471-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@16eb30d5 at consistency null
2022-01-06 09:44:54.251 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1696151471-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:55.026 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:44:55.029 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-12, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:44:55.029 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-12, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:44:55.030 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-12, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:44:55.030 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-12, inFlight=0, closed=true] closing connection
2022-01-06 09:44:55.030 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:44:55.030 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 09:44:55.030 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 16000 ms
2022-01-06 09:44:55.056 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2102345007-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4c26a3b9 at consistency null
2022-01-06 09:44:55.056 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2102345007-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:56.663 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1468327497-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5001bd69 at consistency null
2022-01-06 09:44:56.663 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1468327497-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:44:56.664 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:44:38.989Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:45:01.669 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [950245879-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1cc8a502 at consistency null
2022-01-06 09:45:01.669 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [950245879-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:01.739 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [338392323-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@53ea53d6 at consistency null
2022-01-06 09:45:01.740 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [338392323-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:01.768 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [277452012-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2aa80979 at consistency null
2022-01-06 09:45:01.768 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [277452012-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:01.839 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1615826458-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@779f13b0 at consistency null
2022-01-06 09:45:01.839 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1615826458-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:01.942 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1141362629-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2e2658f4 at consistency null
2022-01-06 09:45:01.943 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1141362629-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:01.959 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version_elements, scheduling delivery
2022-01-06 09:45:02.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [197863723-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2f53da05 at consistency null
2022-01-06 09:45:02.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [197863723-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:02.349 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1471803978-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@45daed57 at consistency null
2022-01-06 09:45:02.349 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1471803978-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:02.753 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1268423161-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4ad764cf at consistency null
2022-01-06 09:45:02.753 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1268423161-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:02.849 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_namespace, scheduling delivery
2022-01-06 09:45:03.157 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [832114344-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@56aa6499 at consistency null
2022-01-06 09:45:03.157 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [832114344-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:03.561 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1665792961-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@67181fbb at consistency null
2022-01-06 09:45:03.561 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1665792961-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:03.654 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element, scheduling delivery
2022-01-06 09:45:03.965 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2080013888-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@75baf65a at consistency null
2022-01-06 09:45:03.965 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2080013888-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:04.551 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_synchronization_state, scheduling delivery
2022-01-06 09:45:04.839 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1680893335-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@43a153e at consistency null
2022-01-06 09:45:04.839 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1680893335-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:05.439 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.element_stage, scheduling delivery
2022-01-06 09:45:05.643 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [489016311-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1b1378c at consistency null
2022-01-06 09:45:05.643 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [489016311-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:05.644 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:44:38.989Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:45:06.254 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE zusammen_dox.version_stage, scheduling delivery
2022-01-06 09:45:07.255 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for zusammen_dox
2022-01-06 09:45:07.265 DEBUG 10 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdctitan.
2022-01-06 09:45:07.273 DEBUG 10 --- [luster-worker-2] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdctitan completed in 8 milliseconds
2022-01-06 09:45:10.649 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [832486497-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@26f315c6 at consistency null
2022-01-06 09:45:10.649 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [832486497-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:10.702 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [431938668-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4592f64 at consistency null
2022-01-06 09:45:10.702 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [431938668-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:10.806 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2118454801-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@501e5934 at consistency null
2022-01-06 09:45:10.806 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2118454801-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:11.010 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1301022813-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@589b19ec at consistency null
2022-01-06 09:45:11.010 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1301022813-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:11.031 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:45:11.033 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-13, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:45:11.034 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-13, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:45:11.034 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-13, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:45:11.034 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-13, inFlight=0, closed=true] closing connection
2022-01-06 09:45:11.034 DEBUG 10 --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:45:11.034 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 09:45:11.034 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 32000 ms
2022-01-06 09:45:11.415 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [162912313-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@66f86a1c at consistency null
2022-01-06 09:45:11.415 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [162912313-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:11.818 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1720133855-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2b174ba8 at consistency null
2022-01-06 09:45:11.818 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1720133855-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:12.624 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [820283288-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@9e27007 at consistency null
2022-01-06 09:45:12.624 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [820283288-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:14.228 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [495435577-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@9364cae at consistency null
2022-01-06 09:45:14.228 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [495435577-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:14.230 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:44:38.989Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:45:19.240 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [987027616-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2c3b6f1e at consistency null
2022-01-06 09:45:19.240 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [987027616-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:19.339 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1707790069-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3d603b3a at consistency null
2022-01-06 09:45:19.339 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1707790069-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:19.443 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1904627091-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@279806d9 at consistency null
2022-01-06 09:45:19.443 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1904627091-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:19.546 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1373129453-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1c706db8 at consistency null
2022-01-06 09:45:19.546 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1373129453-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:19.749 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1297451438-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6b44a2b7 at consistency null
2022-01-06 09:45:19.750 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1297451438-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:20.153 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2119912343-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5741ed0e at consistency null
2022-01-06 09:45:20.153 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2119912343-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:20.558 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1039301402-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@300887f1 at consistency null
2022-01-06 09:45:20.558 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1039301402-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:20.961 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [787403115-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2f0a21e5 at consistency null
2022-01-06 09:45:20.962 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [787403115-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:21.766 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1335305697-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@61957fa9 at consistency null
2022-01-06 09:45:21.766 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1335305697-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:22.570 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1798621303-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@39e4c708 at consistency null
2022-01-06 09:45:22.570 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1798621303-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:22.571 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:44:38.989Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:45:27.575 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1169179808-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4d27f8ca at consistency null
2022-01-06 09:45:27.575 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1169179808-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:27.628 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [487436532-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@33dced82 at consistency null
2022-01-06 09:45:27.629 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [487436532-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:27.682 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1807951513-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@797eb467 at consistency null
2022-01-06 09:45:27.683 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1807951513-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:27.786 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [645475558-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@66bdf0c7 at consistency null
2022-01-06 09:45:27.786 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [645475558-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:27.990 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1638656461-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@14aea572 at consistency null
2022-01-06 09:45:27.990 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1638656461-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:28.394 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [290549532-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@40caea98 at consistency null
2022-01-06 09:45:28.394 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [290549532-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:28.797 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1674863681-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4c1ba36a at consistency null
2022-01-06 09:45:28.798 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1674863681-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:29.601 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [212171457-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@452949e6 at consistency null
2022-01-06 09:45:29.601 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [212171457-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:31.206 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [855510809-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@24cde104 at consistency null
2022-01-06 09:45:31.206 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [855510809-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:31.207 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:44:38.989Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:45:36.210 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [684568533-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@33c4412f at consistency null
2022-01-06 09:45:36.211 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [684568533-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:36.264 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1752903905-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@22d5b4ce at consistency null
2022-01-06 09:45:36.264 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1752903905-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:36.367 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1336884317-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2d3caf0b at consistency null
2022-01-06 09:45:36.367 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1336884317-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:36.470 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [233530486-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6632be69 at consistency null
2022-01-06 09:45:36.471 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [233530486-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:36.574 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1209913625-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@77ee46b9 at consistency null
2022-01-06 09:45:36.574 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1209913625-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:36.677 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2035293379-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7812ff4e at consistency null
2022-01-06 09:45:36.677 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2035293379-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:36.780 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1336646240-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@301e53b0 at consistency null
2022-01-06 09:45:36.780 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1336646240-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:36.884 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [422940471-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@432c722c at consistency null
2022-01-06 09:45:36.884 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [422940471-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:36.988 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1057357841-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@46f22f7e at consistency null
2022-01-06 09:45:36.988 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1057357841-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:37.140 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1187620150-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@29754061 at consistency null
2022-01-06 09:45:37.140 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1187620150-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:37.268 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:45:37.270 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:45:37.343 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1436704533-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6bb4152c at consistency null
2022-01-06 09:45:37.343 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1436704533-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:37.746 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1616592545-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4b29b764 at consistency null
2022-01-06 09:45:37.747 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1616592545-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:38.150 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1876081715-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1c77e8a0 at consistency null
2022-01-06 09:45:38.150 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1876081715-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:38.953 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1689867498-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1f82c507 at consistency null
2022-01-06 09:45:38.953 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1689867498-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:38.954 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:44:38.989Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:45:43.035 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:45:43.037 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-14, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:45:43.037 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-14, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:45:43.037 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-14, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:45:43.038 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-14, inFlight=0, closed=true] closing connection
2022-01-06 09:45:43.038 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:45:43.038 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 09:45:43.038 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 64000 ms
2022-01-06 09:45:43.959 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [589624735-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@78723807 at consistency null
2022-01-06 09:45:43.959 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [589624735-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:44.040 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [439581036-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@922d879 at consistency null
2022-01-06 09:45:44.040 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [439581036-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:44.140 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1618636093-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5ebb8e83 at consistency null
2022-01-06 09:45:44.140 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1618636093-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:44.240 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1321892828-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@249e93da at consistency null
2022-01-06 09:45:44.240 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1321892828-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:44.340 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1254549399-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4d45254e at consistency null
2022-01-06 09:45:44.340 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1254549399-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:44.443 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1270812602-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@523bdd8f at consistency null
2022-01-06 09:45:44.443 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1270812602-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:44.546 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2015330421-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@50769edd at consistency null
2022-01-06 09:45:44.546 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2015330421-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:44.649 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1704329265-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@a6d74a at consistency null
2022-01-06 09:45:44.649 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1704329265-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:44.852 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [403814731-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@64adfd45 at consistency null
2022-01-06 09:45:44.853 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [403814731-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:45.059 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [736147244-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@687693fa at consistency null
2022-01-06 09:45:45.059 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [736147244-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:45.463 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [796431885-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@c12785f at consistency null
2022-01-06 09:45:45.463 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [796431885-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:45.866 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2059045979-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3ab8e210 at consistency null
2022-01-06 09:45:45.866 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2059045979-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:46.670 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1869920678-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@317467d7 at consistency null
2022-01-06 09:45:46.670 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1869920678-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:46.671 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:44:38.989Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:45:51.675 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1099119283-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6dc1cb40 at consistency null
2022-01-06 09:45:51.675 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1099119283-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:51.728 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [715134064-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@728e9627 at consistency null
2022-01-06 09:45:51.728 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [715134064-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:51.831 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [81173803-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@f5b4204 at consistency null
2022-01-06 09:45:51.831 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [81173803-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:52.034 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1319484830-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1d83c6e7 at consistency null
2022-01-06 09:45:52.035 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1319484830-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:52.438 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [371933275-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7e7b95dc at consistency null
2022-01-06 09:45:52.439 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [371933275-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:52.677 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:45:52.680 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-18, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:45:52.680 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-18, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:45:52.680 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-18, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:45:52.681 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-18, inFlight=0, closed=true] closing connection
2022-01-06 09:45:52.681 DEBUG 10 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:45:52.681 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-01-06 09:45:52.681 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 128000 ms
2022-01-06 09:45:53.242 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1006814586-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@78c20b9a at consistency null
2022-01-06 09:45:53.242 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1006814586-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:54.847 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [202188820-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2ddc3de4 at consistency null
2022-01-06 09:45:54.847 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [202188820-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:54.848 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:44:38.989Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:45:59.852 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1864842566-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2e6b6246 at consistency null
2022-01-06 09:45:59.853 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1864842566-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:59.940 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [599953761-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@c1cd722 at consistency null
2022-01-06 09:45:59.940 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [599953761-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:45:59.968 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [155298166-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@646a93e0 at consistency null
2022-01-06 09:45:59.968 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [155298166-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:00.042 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1827241410-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2815a194 at consistency null
2022-01-06 09:46:00.042 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1827241410-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:00.071 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [988983316-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5d999f82 at consistency null
2022-01-06 09:46:00.071 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [988983316-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:00.140 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [227309490-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@37d6f6d4 at consistency null
2022-01-06 09:46:00.140 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [227309490-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:00.169 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [151156076-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@793865d at consistency null
2022-01-06 09:46:00.169 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [151156076-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:00.240 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [773988067-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@28f9e3a at consistency null
2022-01-06 09:46:00.240 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [773988067-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:00.293 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [25131299-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@137b7466 at consistency null
2022-01-06 09:46:00.294 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [25131299-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:00.397 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1872801625-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@131b508b at consistency null
2022-01-06 09:46:00.397 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1872801625-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:00.500 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1964183252-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@8218ddb at consistency null
2022-01-06 09:46:00.500 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1964183252-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:00.703 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1274594195-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7621bcab at consistency null
2022-01-06 09:46:00.704 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1274594195-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:00.940 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [833883566-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3eb12e4d at consistency null
2022-01-06 09:46:00.940 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [833883566-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:01.344 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1535424166-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7767be18 at consistency null
2022-01-06 09:46:01.344 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1535424166-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:02.149 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [915170988-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@732caa7a at consistency null
2022-01-06 09:46:02.150 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [915170988-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:03.753 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [996528053-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@8938450 at consistency null
2022-01-06 09:46:03.753 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [996528053-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:03.754 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:44:38.989Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:46:07.282 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:46:07.285 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:46:08.760 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [707623946-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3fe70049 at consistency null
2022-01-06 09:46:08.760 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [707623946-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:08.789 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1424150127-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@753afed3 at consistency null
2022-01-06 09:46:08.789 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1424150127-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:08.816 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [26110809-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6353e574 at consistency null
2022-01-06 09:46:08.816 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [26110809-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:08.869 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [335746234-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@77764c4a at consistency null
2022-01-06 09:46:08.869 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [335746234-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:26.499 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.66.95:9042, scheduling delivery
2022-01-06 09:46:26.499 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] received event UP
2022-01-06 09:46:27.500 DEBUG 10 --- [luster-worker-5] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.66.95:9042
2022-01-06 09:46:27.505 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] marking host UP
2022-01-06 09:46:27.505 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 09:46:27.506 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.66.95:9042
2022-01-06 09:46:27.506 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:46:27.508 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-15, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:46:28.299 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-15, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:46:28.300 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-15, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:46:28.300 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-15, inFlight=0, closed=true] closing connection
2022-01-06 09:46:28.301 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-15, inFlight=0, closed=true] has already terminated
2022-01-06 09:46:28.301 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:46:28.302 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-16, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:46:28.696 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-16, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:46:28.696 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-16, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:46:28.696 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-16, inFlight=0, closed=true] closing connection
2022-01-06 09:46:28.698 WARN 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Error creating pool to /10.233.66.95:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:46:28.699 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-16, inFlight=0, closed=true] has already terminated
2022-01-06 09:46:28.699 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Connection pool cannot be created, not marking /10.233.66.95:9042 UP
2022-01-06 09:46:28.699 DEBUG 10 --- [luster-worker-6] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] marking host DOWN
2022-01-06 09:46:28.699 DEBUG 10 --- [luster-worker-6] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:46:28.699 DEBUG 10 --- [luster-worker-6] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] starting reconnection attempt
2022-01-06 09:46:28.700 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:46:29.700 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:46:29.702 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-17, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:46:29.797 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-17, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:46:29.797 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-17, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:46:29.797 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-17, inFlight=0, closed=true] closing connection
2022-01-06 09:46:29.798 DEBUG 10 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:46:29.798 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-17, inFlight=0, closed=true] has already terminated
2022-01-06 09:46:29.798 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:46:29.799 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:46:29.799 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 2000 ms
2022-01-06 09:46:31.799 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:46:31.802 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-18, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:46:31.892 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-18, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:46:31.892 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-18, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:46:31.892 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-18, inFlight=0, closed=true] closing connection
2022-01-06 09:46:31.892 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:46:31.893 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-18, inFlight=0, closed=true] has already terminated
2022-01-06 09:46:31.893 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:46:31.893 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:46:31.894 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 4000 ms
2022-01-06 09:46:35.894 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:46:35.897 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-19, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:46:36.192 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-19, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:46:36.193 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-19, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:46:36.193 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-19, inFlight=0, closed=true] closing connection
2022-01-06 09:46:36.193 DEBUG 10 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:46:36.193 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-19, inFlight=0, closed=true] has already terminated
2022-01-06 09:46:36.194 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:46:36.194 ERROR 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:46:36.195 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 8000 ms
2022-01-06 09:46:40.542 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.66.95:9042, scheduling delivery
2022-01-06 09:46:40.542 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] received event DOWN
2022-01-06 09:46:41.542 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:46:44.195 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:46:44.198 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-20, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:46:44.198 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-20, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:46:44.198 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-20, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:46:44.198 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-20, inFlight=0, closed=true] closing connection
2022-01-06 09:46:44.198 DEBUG 10 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:46:44.199 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 09:46:44.199 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 16000 ms
2022-01-06 09:46:44.544 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1831910867-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6173aacf at consistency null
2022-01-06 09:46:44.544 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1831910867-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:44.640 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1160863012-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@71434fdd at consistency null
2022-01-06 09:46:44.640 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1160863012-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:44.743 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1864886513-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@43f71555 at consistency null
2022-01-06 09:46:44.744 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1864886513-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:44.848 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2100910194-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@66043fe6 at consistency null
2022-01-06 09:46:44.849 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2100910194-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:44.955 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [353348643-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1addc43b at consistency null
2022-01-06 09:46:44.955 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [353348643-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:45.159 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1511529435-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@718b4d1a at consistency null
2022-01-06 09:46:45.159 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1511529435-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:45.363 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [170397705-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@aadb3c3 at consistency null
2022-01-06 09:46:45.363 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [170397705-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:45.767 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1030038518-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4d11567f at consistency null
2022-01-06 09:46:45.767 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1030038518-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:46.570 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1441001165-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3999affa at consistency null
2022-01-06 09:46:46.570 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1441001165-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:47.374 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1337975145-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@12d1c64e at consistency null
2022-01-06 09:46:47.374 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1337975145-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:47.376 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:46:38.890Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:46:52.380 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [89983183-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@75055c7c at consistency null
2022-01-06 09:46:52.380 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [89983183-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:52.433 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [297005313-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@32e04e0d at consistency null
2022-01-06 09:46:52.433 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [297005313-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:52.486 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1533862012-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4672c1d4 at consistency null
2022-01-06 09:46:52.486 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1533862012-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:52.539 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1810429649-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5a0d8ce2 at consistency null
2022-01-06 09:46:52.540 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1810429649-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:52.593 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [111054867-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@534dd63 at consistency null
2022-01-06 09:46:52.593 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [111054867-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:52.646 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [137056824-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@35147bee at consistency null
2022-01-06 09:46:52.647 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [137056824-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:52.700 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [880290881-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@653860f9 at consistency null
2022-01-06 09:46:52.700 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [880290881-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:52.804 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [403315297-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@53649a20 at consistency null
2022-01-06 09:46:52.804 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [403315297-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:53.008 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1793466235-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@70988aea at consistency null
2022-01-06 09:46:53.008 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1793466235-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:53.412 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [948845197-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@66c5441c at consistency null
2022-01-06 09:46:53.413 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [948845197-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:53.816 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1306596345-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@405ccf95 at consistency null
2022-01-06 09:46:53.816 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1306596345-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:54.219 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [99664182-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@379ee824 at consistency null
2022-01-06 09:46:54.220 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [99664182-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:55.024 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1605835572-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3e5fbe7 at consistency null
2022-01-06 09:46:55.024 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1605835572-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:55.829 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [371464221-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4fccaa23 at consistency null
2022-01-06 09:46:55.829 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [371464221-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:46:55.830 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:46:38.890Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:47:00.199 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:47:00.201 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-21, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:47:00.202 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-21, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:47:00.202 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-21, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:47:00.202 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-21, inFlight=0, closed=true] closing connection
2022-01-06 09:47:00.202 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:47:00.202 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 09:47:00.202 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 32000 ms
2022-01-06 09:47:00.834 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1402974203-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@694ae428 at consistency null
2022-01-06 09:47:00.835 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1402974203-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:00.941 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1357196751-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2955eeed at consistency null
2022-01-06 09:47:00.945 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1357196751-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:01.049 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [929882716-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5c312e3 at consistency null
2022-01-06 09:47:01.049 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [929882716-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:01.253 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [20901980-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2f742dca at consistency null
2022-01-06 09:47:01.253 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [20901980-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:01.457 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [795899895-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@11a1f7a8 at consistency null
2022-01-06 09:47:01.457 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [795899895-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:01.861 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1443015811-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@170551f7 at consistency null
2022-01-06 09:47:01.861 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1443015811-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:02.265 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [103598621-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@acc1dfe at consistency null
2022-01-06 09:47:02.265 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [103598621-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:03.070 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1894151828-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4d87b10 at consistency null
2022-01-06 09:47:03.071 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1894151828-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:03.941 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1552246960-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1adad094 at consistency null
2022-01-06 09:47:03.941 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1552246960-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:03.942 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:46:38.890Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:47:08.946 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [522236183-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27edb0d1 at consistency null
2022-01-06 09:47:08.946 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [522236183-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:08.999 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2143091916-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4da46a3f at consistency null
2022-01-06 09:47:08.999 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2143091916-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:09.055 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1009612665-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@a638860 at consistency null
2022-01-06 09:47:09.055 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1009612665-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:09.108 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1268402340-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@46f1a7c8 at consistency null
2022-01-06 09:47:09.108 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1268402340-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:09.162 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1370026185-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@c50ecff at consistency null
2022-01-06 09:47:09.162 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1370026185-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:09.265 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1231699116-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@624b8ad8 at consistency null
2022-01-06 09:47:09.265 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1231699116-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:09.369 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [506137671-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@747d3e79 at consistency null
2022-01-06 09:47:09.369 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [506137671-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:09.472 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [133019726-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3ff908d9 at consistency null
2022-01-06 09:47:09.473 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [133019726-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:09.676 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [299183810-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@34453ccd at consistency null
2022-01-06 09:47:09.676 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [299183810-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:09.880 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [163774216-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ae66dd7 at consistency null
2022-01-06 09:47:09.880 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [163774216-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:10.284 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1338872643-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@17750404 at consistency null
2022-01-06 09:47:10.284 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1338872643-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:10.554 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:47:10.557 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:47:11.087 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [629697852-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@60bd69f3 at consistency null
2022-01-06 09:47:11.087 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [629697852-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:11.891 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [496231537-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7d03827d at consistency null
2022-01-06 09:47:11.891 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [496231537-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:11.892 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:46:38.890Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:47:16.896 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [53961332-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4432c0df at consistency null
2022-01-06 09:47:16.896 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [53961332-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:16.941 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [549695194-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7b58b979 at consistency null
2022-01-06 09:47:16.941 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [549695194-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:16.994 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1187300979-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@70a1b510 at consistency null
2022-01-06 09:47:16.995 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1187300979-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:17.141 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1156973238-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1150c113 at consistency null
2022-01-06 09:47:17.141 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1156973238-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:17.249 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2095770782-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@43b6dfde at consistency null
2022-01-06 09:47:17.249 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2095770782-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:17.453 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1096951975-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7d9b35a0 at consistency null
2022-01-06 09:47:17.453 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1096951975-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:17.859 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [561351078-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ef1636 at consistency null
2022-01-06 09:47:17.859 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [561351078-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:18.667 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1432538252-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@17a00761 at consistency null
2022-01-06 09:47:18.667 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1432538252-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:19.473 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2126992546-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@621d7264 at consistency null
2022-01-06 09:47:19.473 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2126992546-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:20.278 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [783314125-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@460f7db2 at consistency null
2022-01-06 09:47:20.279 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [783314125-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:20.280 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:46:38.890Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:47:25.295 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [595978244-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3ea98de3 at consistency null
2022-01-06 09:47:25.296 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [595978244-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:25.352 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1623213652-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@29a50e58 at consistency null
2022-01-06 09:47:25.352 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1623213652-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:25.455 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [619080874-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@20a2d75a at consistency null
2022-01-06 09:47:25.456 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [619080874-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:25.659 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [161331967-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1d7dcc11 at consistency null
2022-01-06 09:47:25.659 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [161331967-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:25.863 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [89433600-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6f498cc8 at consistency null
2022-01-06 09:47:25.864 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [89433600-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:26.067 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1740939800-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6e9f98b7 at consistency null
2022-01-06 09:47:26.067 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1740939800-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:26.272 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1884291446-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@8533e05 at consistency null
2022-01-06 09:47:26.272 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1884291446-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:26.481 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [343807937-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1a9b5598 at consistency null
2022-01-06 09:47:26.482 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [343807937-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:26.885 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [876267496-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4eaf74b0 at consistency null
2022-01-06 09:47:26.885 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [876267496-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:27.689 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1982621461-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1be6f997 at consistency null
2022-01-06 09:47:27.689 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1982621461-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:28.493 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [101155607-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@a544ff8 at consistency null
2022-01-06 09:47:28.493 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [101155607-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:28.494 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:46:38.890Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:47:32.203 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:47:32.206 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-22, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:47:32.207 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-22, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:47:32.207 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-22, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:47:32.207 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-22, inFlight=0, closed=true] closing connection
2022-01-06 09:47:32.208 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:47:32.208 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 09:47:32.209 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 64000 ms
2022-01-06 09:47:33.498 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1654873097-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4aa3ecbf at consistency null
2022-01-06 09:47:33.499 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1654873097-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:33.526 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [12898866-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7f9c0baf at consistency null
2022-01-06 09:47:33.527 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [12898866-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:33.580 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [365234672-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@539a7f8a at consistency null
2022-01-06 09:47:33.580 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [365234672-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:33.683 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [803221348-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7b19c18e at consistency null
2022-01-06 09:47:33.683 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [803221348-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:33.788 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1474002309-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2e0a1c46 at consistency null
2022-01-06 09:47:33.788 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1474002309-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:33.993 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1906860046-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@31d4bb5b at consistency null
2022-01-06 09:47:33.993 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1906860046-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:34.397 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1277128002-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@31b2e4c4 at consistency null
2022-01-06 09:47:34.397 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1277128002-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:35.200 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1655369898-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@41256cd at consistency null
2022-01-06 09:47:35.201 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1655369898-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:36.808 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1846648367-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7a049225 at consistency null
2022-01-06 09:47:36.808 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1846648367-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:47:36.809 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:46:38.890Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:47:40.557 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:47:40.560 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:47:51.960 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.66.95:9042, scheduling delivery
2022-01-06 09:47:51.961 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] received event UP
2022-01-06 09:47:52.962 DEBUG 10 --- [luster-worker-8] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.66.95:9042
2022-01-06 09:47:52.966 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] marking host UP
2022-01-06 09:47:52.966 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 09:47:52.967 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.66.95:9042
2022-01-06 09:47:52.967 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:47:52.969 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-23, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:47:54.002 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-23, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:47:54.003 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-23, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:47:54.003 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-23, inFlight=0, closed=true] closing connection
2022-01-06 09:47:54.004 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-23, inFlight=0, closed=true] has already terminated
2022-01-06 09:47:54.004 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:47:54.006 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-24, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:47:54.391 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-24, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:47:54.391 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-24, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:47:54.392 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-24, inFlight=0, closed=true] closing connection
2022-01-06 09:47:54.393 WARN 10 --- [er-nio-worker-2] com.datastax.driver.core.Session : Error creating pool to /10.233.66.95:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:47:54.394 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Connection pool cannot be created, not marking /10.233.66.95:9042 UP
2022-01-06 09:47:54.394 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] marking host DOWN
2022-01-06 09:47:54.394 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-24, inFlight=0, closed=true] has already terminated
2022-01-06 09:47:54.394 DEBUG 10 --- [luster-worker-7] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:47:54.395 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] starting reconnection attempt
2022-01-06 09:47:54.395 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:47:55.395 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:47:55.397 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-25, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:47:55.506 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-25, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:47:55.507 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-25, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:47:55.507 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-25, inFlight=0, closed=true] closing connection
2022-01-06 09:47:55.507 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:47:55.508 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-25, inFlight=0, closed=true] has already terminated
2022-01-06 09:47:55.509 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:47:55.510 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:47:55.511 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 2000 ms
2022-01-06 09:47:57.511 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:47:57.514 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-26, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:47:57.598 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-26, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:47:57.598 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-26, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:47:57.598 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-26, inFlight=0, closed=true] closing connection
2022-01-06 09:47:57.598 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:47:57.599 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-26, inFlight=0, closed=true] has already terminated
2022-01-06 09:47:57.599 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:47:57.599 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:47:57.601 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 4000 ms
2022-01-06 09:48:00.681 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:00.684 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-19, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:48:00.684 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-19, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:48:00.684 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-19, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:00.685 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-19, inFlight=0, closed=true] closing connection
2022-01-06 09:48:00.685 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:48:00.685 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 256000 milliseconds
2022-01-06 09:48:00.685 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 256000 ms
2022-01-06 09:48:01.601 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:01.605 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-27, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:48:04.702 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-27, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:48:04.702 DEBUG 10 --- [-reconnection-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.66.95:9042
2022-01-06 09:48:04.743 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Successful reconnection to /10.233.66.95:9042, setting host UP
2022-01-06 09:48:04.743 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] marking host UP
2022-01-06 09:48:04.744 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 09:48:04.744 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.66.95:9042
2022-01-06 09:48:04.903 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 0 new connections, total = 1
2022-01-06 09:48:04.903 DEBUG 10 --- [-reconnection-1] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.66.95:9042 (1 connections needed, 1 successfully opened)
2022-01-06 09:48:04.903 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Session : Added connection pool for /10.233.66.95:9042
2022-01-06 09:48:04.903 DEBUG 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2022-01-06 09:48:16.010 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 09:48:16.010 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 09:48:17.011 DEBUG 10 --- [luster-worker-8] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 09:48:17.047 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 09:48:17.047 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 09:48:17.047 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 09:48:17.047 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:17.049 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-20, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:48:20.118 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-27, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:48:20.118 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-27, inFlight=0, closed=false] because: [/10.233.66.95:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 09:48:20.118 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preventing new connections for the next 1000 ms
2022-01-06 09:48:20.118 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-27, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:20.118 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-27, inFlight=0, closed=true] closing connection
2022-01-06 09:48:20.118 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] marking host DOWN
2022-01-06 09:48:20.119 DEBUG 10 --- [luster-worker-7] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:48:20.119 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] starting reconnection attempt
2022-01-06 09:48:20.243 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.66.95:9042, scheduling delivery
2022-01-06 09:48:20.244 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] received event DOWN
2022-01-06 09:48:21.119 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:21.122 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-28, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:48:21.122 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-28, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:48:21.122 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-28, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:21.122 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-28, inFlight=0, closed=true] closing connection
2022-01-06 09:48:21.122 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:48:21.122 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 09:48:21.122 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 2000 ms
2022-01-06 09:48:21.244 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:48:23.123 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:23.125 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-29, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:48:23.125 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-29, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:48:23.126 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-29, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:23.126 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-29, inFlight=0, closed=true] closing connection
2022-01-06 09:48:23.126 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:48:23.126 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 09:48:23.126 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 4000 ms
2022-01-06 09:48:23.159 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-20, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:48:23.468 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 0 new connections, total = 1
2022-01-06 09:48:23.468 DEBUG 10 --- [luster-worker-8] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 1 successfully opened)
2022-01-06 09:48:23.468 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 09:48:25.567 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-20, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:48:25.567 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-20, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 09:48:25.568 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 09:48:25.568 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-20, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:25.568 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 09:48:25.568 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-20, inFlight=0, closed=true] closing connection
2022-01-06 09:48:25.569 DEBUG 10 --- [luster-worker-7] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:48:25.569 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 09:48:25.804 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 09:48:25.804 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 09:48:26.569 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:26.571 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-21, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:48:26.571 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-21, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:48:26.571 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-21, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:26.571 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-21, inFlight=0, closed=true] closing connection
2022-01-06 09:48:26.571 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:48:26.572 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 09:48:26.572 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 09:48:26.804 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:48:27.127 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:27.129 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-30, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:48:27.129 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-30, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:48:27.129 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-30, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:27.130 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-30, inFlight=0, closed=true] closing connection
2022-01-06 09:48:27.130 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:48:27.130 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 09:48:27.130 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 8000 ms
2022-01-06 09:48:27.560 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [85033933-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3353b862 at consistency null
2022-01-06 09:48:27.561 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [85033933-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:27.613 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [468050364-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2ae9dba5 at consistency null
2022-01-06 09:48:27.614 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [468050364-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:27.666 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2035773096-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7288e7ea at consistency null
2022-01-06 09:48:27.666 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2035773096-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:27.719 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [34717177-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@153ca7a5 at consistency null
2022-01-06 09:48:27.719 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [34717177-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:27.822 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [186079645-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3b829dc8 at consistency null
2022-01-06 09:48:27.822 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [186079645-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:28.025 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1061925186-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5f525dee at consistency null
2022-01-06 09:48:28.025 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1061925186-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:28.428 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2100013613-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6ad04659 at consistency null
2022-01-06 09:48:28.429 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2100013613-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:28.572 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:28.574 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-22, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:48:28.574 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-22, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:48:28.574 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-22, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:28.574 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-22, inFlight=0, closed=true] closing connection
2022-01-06 09:48:28.575 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:48:28.575 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 09:48:28.575 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 09:48:29.232 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1918516740-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1a21d529 at consistency null
2022-01-06 09:48:29.232 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1918516740-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:30.835 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1127242339-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@35626778 at consistency null
2022-01-06 09:48:30.835 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1127242339-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:30.836 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:48:20Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:48:32.575 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:32.577 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-23, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:48:32.578 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-23, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:48:32.578 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-23, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:32.578 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-23, inFlight=0, closed=true] closing connection
2022-01-06 09:48:32.578 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:48:32.578 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 09:48:32.578 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 09:48:35.132 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:35.139 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-31, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:48:35.139 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-31, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:48:35.140 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-31, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:35.140 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-31, inFlight=0, closed=true] closing connection
2022-01-06 09:48:35.140 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:48:35.141 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 09:48:35.141 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 16000 ms
2022-01-06 09:48:35.849 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [554902246-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7892f117 at consistency null
2022-01-06 09:48:35.849 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [554902246-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:35.902 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [29990443-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@101892d2 at consistency null
2022-01-06 09:48:35.902 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [29990443-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:35.955 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [583023112-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4848565 at consistency null
2022-01-06 09:48:35.955 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [583023112-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:36.058 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1667407729-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@22fb7b2a at consistency null
2022-01-06 09:48:36.058 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1667407729-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:36.167 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1541309929-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4d0e2c2b at consistency null
2022-01-06 09:48:36.167 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1541309929-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:36.378 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [371941503-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1954b95a at consistency null
2022-01-06 09:48:36.378 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [371941503-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:36.583 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [890767560-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@39dbb8b8 at consistency null
2022-01-06 09:48:36.583 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [890767560-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:36.794 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1123450893-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4000b682 at consistency null
2022-01-06 09:48:36.795 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1123450893-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:37.202 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1831384183-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7cd3b5dd at consistency null
2022-01-06 09:48:37.202 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1831384183-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:38.046 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [541919541-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@40f14d74 at consistency null
2022-01-06 09:48:38.046 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [541919541-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:39.650 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1441143740-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@240b33aa at consistency null
2022-01-06 09:48:39.650 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1441143740-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:39.652 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:48:20Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:48:40.579 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:40.584 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-24, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:48:40.584 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-24, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:48:40.584 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-24, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:40.584 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-24, inFlight=0, closed=true] closing connection
2022-01-06 09:48:40.584 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:48:40.585 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 09:48:40.585 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 09:48:44.657 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [602284005-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4a366e25 at consistency null
2022-01-06 09:48:44.657 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [602284005-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:44.685 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [189111522-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@37dd92aa at consistency null
2022-01-06 09:48:44.685 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [189111522-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:44.742 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1124677662-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7bf9b03 at consistency null
2022-01-06 09:48:44.742 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1124677662-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:44.795 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [651685944-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@37a4a94d at consistency null
2022-01-06 09:48:44.795 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [651685944-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:44.942 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [903727664-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4e1aaeda at consistency null
2022-01-06 09:48:44.942 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [903727664-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:45.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [307819237-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@15893d71 at consistency null
2022-01-06 09:48:45.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [307819237-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:45.350 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [412868984-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6e15db40 at consistency null
2022-01-06 09:48:45.350 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [412868984-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:45.753 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [30708835-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7ce9e90e at consistency null
2022-01-06 09:48:45.753 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [30708835-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:46.156 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1510162979-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@679ee437 at consistency null
2022-01-06 09:48:46.157 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1510162979-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:46.560 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [261704796-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3ba02f00 at consistency null
2022-01-06 09:48:46.560 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [261704796-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:47.365 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1213132022-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7b2f2cef at consistency null
2022-01-06 09:48:47.365 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1213132022-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:48.168 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1830555152-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@483d0b1d at consistency null
2022-01-06 09:48:48.168 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1830555152-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:48.169 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:48:20Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:48:51.142 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:51.144 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-32, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:48:51.145 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-32, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:48:51.146 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-32, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:51.147 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-32, inFlight=0, closed=true] closing connection
2022-01-06 09:48:51.147 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 09:48:51.147 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:48:51.147 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 32000 ms
2022-01-06 09:48:53.175 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [768498634-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5892e171 at consistency null
2022-01-06 09:48:53.175 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [768498634-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:53.228 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1752172931-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@62f01d4c at consistency null
2022-01-06 09:48:53.228 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1752172931-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:53.281 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1474720039-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@603a1da9 at consistency null
2022-01-06 09:48:53.281 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1474720039-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:53.334 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1518831941-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@40ff9750 at consistency null
2022-01-06 09:48:53.334 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1518831941-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:53.437 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [97028564-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@fa97f57 at consistency null
2022-01-06 09:48:53.438 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [97028564-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:53.641 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1830597887-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6dd11993 at consistency null
2022-01-06 09:48:53.641 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1830597887-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:54.044 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [160931634-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5db696d5 at consistency null
2022-01-06 09:48:54.044 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [160931634-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:54.849 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1874649828-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@61cfdf24 at consistency null
2022-01-06 09:48:54.849 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1874649828-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:55.825 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:48:55.828 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:48:56.452 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [788218094-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@25d8578d at consistency null
2022-01-06 09:48:56.453 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [788218094-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:48:56.454 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:48:20Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:48:56.585 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:48:56.587 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-25, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:48:56.588 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-25, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:48:56.588 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-25, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:48:56.588 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-25, inFlight=0, closed=true] closing connection
2022-01-06 09:48:56.588 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:48:56.588 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 09:48:56.588 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 09:49:01.457 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [650683010-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4020df24 at consistency null
2022-01-06 09:49:01.457 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [650683010-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:01.542 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [328451942-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2949e9cb at consistency null
2022-01-06 09:49:01.542 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [328451942-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:01.646 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [464563250-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@36e02539 at consistency null
2022-01-06 09:49:01.646 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [464563250-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:01.850 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1865970586-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@51e36857 at consistency null
2022-01-06 09:49:01.850 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1865970586-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:02.053 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [210174029-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@177c54b0 at consistency null
2022-01-06 09:49:02.053 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [210174029-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:02.457 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [27414092-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@711df025 at consistency null
2022-01-06 09:49:02.457 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [27414092-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:02.862 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [527278966-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4663cad2 at consistency null
2022-01-06 09:49:02.862 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [527278966-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:03.665 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [870688674-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@c08b399 at consistency null
2022-01-06 09:49:03.666 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [870688674-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:04.469 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [131353851-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@79a4af7c at consistency null
2022-01-06 09:49:04.469 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [131353851-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:04.470 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:48:20Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:49:09.474 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [337093219-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6726f4b5 at consistency null
2022-01-06 09:49:09.474 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [337093219-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:09.501 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1712575876-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f4b87d9 at consistency null
2022-01-06 09:49:09.501 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1712575876-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:09.555 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2027267667-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@76167fd2 at consistency null
2022-01-06 09:49:09.555 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2027267667-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:09.658 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1564712486-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2a15e123 at consistency null
2022-01-06 09:49:09.658 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1564712486-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:09.761 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1953381207-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7a462b88 at consistency null
2022-01-06 09:49:09.761 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1953381207-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:09.963 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [212430763-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@19d01e56 at consistency null
2022-01-06 09:49:09.964 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [212430763-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:10.166 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1494984531-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5cfd0a51 at consistency null
2022-01-06 09:49:10.167 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1494984531-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:10.571 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [409510136-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@59e4e414 at consistency null
2022-01-06 09:49:10.571 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [409510136-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:10.974 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [492409889-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@12b59ecb at consistency null
2022-01-06 09:49:10.974 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [492409889-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:11.377 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1514824726-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@b8e1065 at consistency null
2022-01-06 09:49:11.378 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1514824726-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:12.181 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1584361779-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f953cc7 at consistency null
2022-01-06 09:49:12.181 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1584361779-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:12.182 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:48:20Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:49:17.242 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [56456550-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@412fab65 at consistency null
2022-01-06 09:49:17.242 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [56456550-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:17.270 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1391727024-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7fd2364d at consistency null
2022-01-06 09:49:17.270 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1391727024-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:17.342 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1536664876-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4a40cea at consistency null
2022-01-06 09:49:17.343 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1536664876-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:17.370 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2119475588-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@12c17bbd at consistency null
2022-01-06 09:49:17.370 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2119475588-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:17.442 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [373955949-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2e098e03 at consistency null
2022-01-06 09:49:17.442 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [373955949-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:17.495 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1690429317-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4087a5d1 at consistency null
2022-01-06 09:49:17.495 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1690429317-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:17.642 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [43618548-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@64603277 at consistency null
2022-01-06 09:49:17.643 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [43618548-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:17.846 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1494899106-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7d65b1d5 at consistency null
2022-01-06 09:49:17.846 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1494899106-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:18.249 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [528320153-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1ffe51ec at consistency null
2022-01-06 09:49:18.250 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [528320153-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:18.653 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1961600828-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@622ac6ef at consistency null
2022-01-06 09:49:18.653 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1961600828-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:19.457 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [985372517-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7bca357 at consistency null
2022-01-06 09:49:19.457 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [985372517-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:20.260 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [837230297-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5707416c at consistency null
2022-01-06 09:49:20.260 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [837230297-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:21.064 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1121787698-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3a1b1b51 at consistency null
2022-01-06 09:49:21.064 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1121787698-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:21.065 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:48:20Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:49:23.147 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:49:23.150 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-33, inFlight=0, closed=false] Error connecting to /10.233.66.95:9042 (Connection refused: /10.233.66.95:9042)
2022-01-06 09:49:23.151 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-33, inFlight=0, closed=false] because: [/10.233.66.95:9042] Cannot connect
2022-01-06 09:49:23.151 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-33, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:49:23.151 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-33, inFlight=0, closed=true] closing connection
2022-01-06 09:49:23.151 DEBUG 10 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:49:23.152 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.66.95:9042 ([/10.233.66.95:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 09:49:23.152 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 64000 ms
2022-01-06 09:49:25.839 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:49:25.841 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:49:26.068 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1806074386-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@eb2af43 at consistency null
2022-01-06 09:49:26.068 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1806074386-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:26.121 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [230695100-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6c7613d9 at consistency null
2022-01-06 09:49:26.121 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [230695100-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:26.173 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [81327627-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@197331a at consistency null
2022-01-06 09:49:26.173 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [81327627-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:26.226 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [777407789-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@633471ea at consistency null
2022-01-06 09:49:26.226 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [777407789-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:26.280 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1900014823-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@78671278 at consistency null
2022-01-06 09:49:26.280 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1900014823-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:26.383 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2104948668-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@24532e76 at consistency null
2022-01-06 09:49:26.383 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2104948668-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:26.487 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1046298295-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1c64d605 at consistency null
2022-01-06 09:49:26.487 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1046298295-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:26.591 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [587080564-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1c2b627b at consistency null
2022-01-06 09:49:26.591 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [587080564-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:26.694 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [749255448-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2136cf16 at consistency null
2022-01-06 09:49:26.694 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [749255448-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:26.897 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1722380838-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1b58f1cb at consistency null
2022-01-06 09:49:26.897 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1722380838-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:27.300 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [836128962-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3d1bd8ad at consistency null
2022-01-06 09:49:27.300 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [836128962-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:27.703 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1650466831-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7ae45dcf at consistency null
2022-01-06 09:49:27.703 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1650466831-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:28.507 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [200881952-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6dbd73fa at consistency null
2022-01-06 09:49:28.507 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [200881952-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:28.508 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:48:20Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:49:28.588 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:49:28.591 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-26, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:49:28.591 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-26, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:49:28.591 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-26, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:49:28.592 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-26, inFlight=0, closed=true] closing connection
2022-01-06 09:49:28.592 DEBUG 10 --- [uster-worker-10] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:49:28.592 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 09:49:28.592 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 09:49:33.512 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [653020219-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@c7cccad at consistency null
2022-01-06 09:49:33.512 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [653020219-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:33.564 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [633296996-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5cb9a64 at consistency null
2022-01-06 09:49:33.564 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [633296996-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:33.666 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1178363012-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4089180 at consistency null
2022-01-06 09:49:33.666 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1178363012-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:33.869 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [79563604-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4cfd180a at consistency null
2022-01-06 09:49:33.869 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [79563604-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:34.072 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1081545324-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@260ebc9c at consistency null
2022-01-06 09:49:34.072 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1081545324-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:34.475 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [533995134-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7fcf1a83 at consistency null
2022-01-06 09:49:34.475 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [533995134-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:34.878 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [988369220-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f0b106b at consistency null
2022-01-06 09:49:34.878 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [988369220-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:35.282 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1324943846-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1b1272c8 at consistency null
2022-01-06 09:49:35.282 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1324943846-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:36.085 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [921015847-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@48abd76a at consistency null
2022-01-06 09:49:36.085 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [921015847-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:36.086 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:48:20Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:49:41.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [167594347-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f37d7fe at consistency null
2022-01-06 09:49:41.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [167594347-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:41.243 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2037271137-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@28581e3b at consistency null
2022-01-06 09:49:41.243 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2037271137-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:41.296 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2136918675-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@20d4bdca at consistency null
2022-01-06 09:49:41.296 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2136918675-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:41.348 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1703948273-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@36523e3d at consistency null
2022-01-06 09:49:41.349 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1703948273-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:41.452 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [105219129-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@472b972e at consistency null
2022-01-06 09:49:41.452 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [105219129-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:41.555 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [225704914-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2feae036 at consistency null
2022-01-06 09:49:41.555 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [225704914-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:41.758 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [74490557-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2ad522ec at consistency null
2022-01-06 09:49:41.758 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [74490557-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:41.961 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1618733669-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@dd1425d at consistency null
2022-01-06 09:49:41.961 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1618733669-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:42.165 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1245044255-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@16d8362e at consistency null
2022-01-06 09:49:42.165 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1245044255-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:42.568 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1477050848-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6ecb9f93 at consistency null
2022-01-06 09:49:42.568 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1477050848-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:43.371 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1508779286-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6d0a12e4 at consistency null
2022-01-06 09:49:43.371 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1508779286-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:44.976 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1727648908-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3d704493 at consistency null
2022-01-06 09:49:44.976 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1727648908-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:44.977 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-01-06T09:48:20Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.233.71.39:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-01-06 09:49:49.981 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [39332714-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@f7563a9 at consistency null
2022-01-06 09:49:49.982 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [39332714-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:50.009 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [173359040-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@32d5dd91 at consistency null
2022-01-06 09:49:50.009 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [173359040-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:50.061 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [574323977-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2bb7d69f at consistency null
2022-01-06 09:49:50.061 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [574323977-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:50.165 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [172920950-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@14dc5ba6 at consistency null
2022-01-06 09:49:50.165 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [172920950-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:50.269 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1225713966-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@30901abf at consistency null
2022-01-06 09:49:50.269 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1225713966-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:50.372 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1787196656-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2cb57069 at consistency null
2022-01-06 09:49:50.372 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1787196656-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:50.475 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [330080156-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3923584e at consistency null
2022-01-06 09:49:50.475 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [330080156-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:50.579 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1830772927-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4fd425a7 at consistency null
2022-01-06 09:49:50.579 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1830772927-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:50.783 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1399235499-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7f218b00 at consistency null
2022-01-06 09:49:50.783 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1399235499-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:50.986 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [169766083-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@78909ab5 at consistency null
2022-01-06 09:49:50.987 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [169766083-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:51.191 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2109297251-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5bd25cc1 at consistency null
2022-01-06 09:49:51.191 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2109297251-0] Error querying cassandra/10.233.71.39:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-01-06 09:49:55.842 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:49:55.845 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:50:06.095 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.66.95:9042, scheduling delivery
2022-01-06 09:50:06.096 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] received event UP
2022-01-06 09:50:07.097 DEBUG 10 --- [uster-worker-11] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.66.95:9042
2022-01-06 09:50:07.102 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] marking host UP
2022-01-06 09:50:07.102 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 09:50:07.103 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.66.95:9042
2022-01-06 09:50:07.103 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:50:07.106 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-34, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:50:08.003 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-34, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:08.004 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-34, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:50:08.004 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-34, inFlight=0, closed=true] closing connection
2022-01-06 09:50:08.005 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-34, inFlight=0, closed=true] has already terminated
2022-01-06 09:50:08.005 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:50:08.007 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-35, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:50:08.312 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-35, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:08.312 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-35, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:50:08.312 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-35, inFlight=0, closed=true] closing connection
2022-01-06 09:50:08.313 WARN 10 --- [er-nio-worker-3] com.datastax.driver.core.Session : Error creating pool to /10.233.66.95:9042
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:50:08.314 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-35, inFlight=0, closed=true] has already terminated
2022-01-06 09:50:08.314 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Cluster : Connection pool cannot be created, not marking /10.233.66.95:9042 UP
2022-01-06 09:50:08.315 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] marking host DOWN
2022-01-06 09:50:08.315 DEBUG 10 --- [uster-worker-12] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:50:08.315 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] starting reconnection attempt
2022-01-06 09:50:08.315 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:50:09.315 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:50:09.318 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-36, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:50:09.493 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-36, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:09.493 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-36, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:50:09.493 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-36, inFlight=0, closed=true] closing connection
2022-01-06 09:50:09.494 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:50:09.494 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-36, inFlight=0, closed=true] has already terminated
2022-01-06 09:50:09.494 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:09.495 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:50:09.495 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 2000 ms
2022-01-06 09:50:11.495 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:50:11.498 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-37, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:50:11.604 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-37, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:11.604 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-37, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:50:11.604 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-37, inFlight=0, closed=true] closing connection
2022-01-06 09:50:11.604 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:50:11.605 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-37, inFlight=0, closed=true] has already terminated
2022-01-06 09:50:11.605 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:11.605 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:50:11.606 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 4000 ms
2022-01-06 09:50:15.607 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:50:15.608 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-38, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:50:15.697 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-38, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:15.697 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-38, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:50:15.697 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-38, inFlight=0, closed=true] closing connection
2022-01-06 09:50:15.697 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:50:15.698 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-38, inFlight=0, closed=true] has already terminated
2022-01-06 09:50:15.698 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:15.698 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:50:15.699 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 8000 ms
2022-01-06 09:50:23.699 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:50:23.701 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-39, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:50:23.792 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-39, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:23.792 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-39, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:50:23.792 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-39, inFlight=0, closed=true] closing connection
2022-01-06 09:50:23.792 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:50:23.793 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-39, inFlight=0, closed=true] has already terminated
2022-01-06 09:50:23.793 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:23.794 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:50:23.795 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 16000 ms
2022-01-06 09:50:32.593 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:50:32.595 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-27, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:50:32.595 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-27, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:50:32.595 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-27, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:50:32.596 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-27, inFlight=0, closed=true] closing connection
2022-01-06 09:50:32.596 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:50:32.596 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-01-06 09:50:32.596 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 128000 ms
2022-01-06 09:50:37.110 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:50:37.143 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:50:39.795 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:50:39.798 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-40, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:50:39.807 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-40, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:39.807 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-40, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:50:39.807 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-40, inFlight=0, closed=true] closing connection
2022-01-06 09:50:39.807 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:50:39.808 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-40, inFlight=0, closed=true] has already terminated
2022-01-06 09:50:39.808 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:50:39.808 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 32000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:50:39.809 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 32000 ms
2022-01-06 09:51:07.143 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:51:07.147 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:51:11.809 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:51:11.811 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-41, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:51:11.816 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-41, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:51:11.816 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-41, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:51:11.816 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-41, inFlight=0, closed=true] closing connection
2022-01-06 09:51:11.817 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:51:11.817 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-41, inFlight=0, closed=true] has already terminated
2022-01-06 09:51:11.817 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:51:11.817 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 64000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:51:11.819 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 64000 ms
2022-01-06 09:51:37.162 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:51:37.165 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:52:07.190 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:52:07.193 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:52:15.819 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:52:15.822 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-42, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:52:15.828 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-42, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:52:15.829 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-42, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:52:15.829 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-42, inFlight=0, closed=true] closing connection
2022-01-06 09:52:15.830 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:52:15.830 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-42, inFlight=0, closed=true] has already terminated
2022-01-06 09:52:15.830 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:52:15.831 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 128000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:52:15.832 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 128000 ms
2022-01-06 09:52:37.218 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:52:37.245 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:52:40.596 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:52:40.599 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-28, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:52:40.599 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-28, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:52:40.599 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-28, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:52:40.600 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-28, inFlight=0, closed=true] closing connection
2022-01-06 09:52:40.600 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:52:40.600 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 256000 milliseconds
2022-01-06 09:52:40.600 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 256000 ms
2022-01-06 09:53:07.246 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:53:07.255 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:53:37.266 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:53:37.270 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:54:07.294 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:54:07.296 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:54:23.832 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:54:23.835 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-43, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:54:23.846 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-43, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:54:23.846 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-43, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:54:23.847 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-43, inFlight=0, closed=true] closing connection
2022-01-06 09:54:23.847 DEBUG 10 --- [uster-worker-16] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:54:23.848 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-43, inFlight=0, closed=true] has already terminated
2022-01-06 09:54:23.848 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:54:23.848 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 256000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:54:23.849 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 256000 ms
2022-01-06 09:54:37.323 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:54:37.347 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:55:07.347 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:55:07.351 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:55:10.766 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 09:55:10.767 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 09:55:11.768 DEBUG 10 --- [uster-worker-17] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 09:55:11.775 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 09:55:11.775 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 09:55:11.775 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 09:55:11.775 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:55:11.778 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-29, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:55:17.464 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-29, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:55:17.664 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 0 new connections, total = 1
2022-01-06 09:55:17.665 DEBUG 10 --- [uster-worker-17] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 1 successfully opened)
2022-01-06 09:55:17.665 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 09:55:41.780 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:55:41.846 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:55:45.372 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-29, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:55:45.372 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-29, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 09:55:45.373 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 09:55:45.373 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-29, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:55:45.373 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-29, inFlight=0, closed=true] closing connection
2022-01-06 09:55:45.373 DEBUG 10 --- [uster-worker-18] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 09:55:45.374 DEBUG 10 --- [uster-worker-18] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:55:45.374 DEBUG 10 --- [uster-worker-18] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 09:55:45.477 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 09:55:45.477 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 09:55:46.374 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:55:46.377 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-30, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:55:46.377 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-30, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:55:46.377 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-30, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:55:46.378 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-30, inFlight=0, closed=true] closing connection
2022-01-06 09:55:46.378 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:55:46.378 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 09:55:46.378 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 09:55:46.478 DEBUG 10 --- [uster-worker-18] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:55:48.378 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:55:48.381 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-31, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:55:48.382 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-31, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:55:48.382 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-31, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:55:48.382 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-31, inFlight=0, closed=true] closing connection
2022-01-06 09:55:48.382 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:55:48.382 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 09:55:48.382 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 09:55:52.383 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:55:52.385 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-32, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:55:52.386 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-32, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:55:52.386 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-32, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:55:52.386 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-32, inFlight=0, closed=true] closing connection
2022-01-06 09:55:52.387 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 09:55:52.387 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 09:55:52.387 DEBUG 10 --- [uster-worker-18] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:56:00.388 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:56:00.392 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-33, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:56:00.392 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-33, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:56:00.392 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-33, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:56:00.392 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-33, inFlight=0, closed=true] closing connection
2022-01-06 09:56:00.393 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:56:00.393 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 09:56:00.393 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 09:56:15.478 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:56:15.480 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:56:16.393 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:56:16.395 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-34, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:56:16.396 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-34, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:56:16.396 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-34, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:56:16.396 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-34, inFlight=0, closed=true] closing connection
2022-01-06 09:56:16.396 DEBUG 10 --- [uster-worker-18] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:56:16.396 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 09:56:16.396 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 09:56:45.509 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:56:45.514 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:56:48.397 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:56:48.399 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-35, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:56:48.399 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-35, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:56:48.399 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-35, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:56:48.400 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-35, inFlight=0, closed=true] closing connection
2022-01-06 09:56:48.400 DEBUG 10 --- [uster-worker-19] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:56:48.400 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 09:56:48.400 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 09:56:49.659 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 09:56:49.659 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 09:56:50.660 DEBUG 10 --- [uster-worker-20] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 09:56:50.666 DEBUG 10 --- [uster-worker-20] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 09:56:50.666 DEBUG 10 --- [uster-worker-20] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 09:56:50.666 DEBUG 10 --- [uster-worker-20] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 09:56:50.666 DEBUG 10 --- [uster-worker-20] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:56:50.669 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-36, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:56:51.471 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-36, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 09:56:51.668 DEBUG 10 --- [uster-worker-20] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 0 new connections, total = 1
2022-01-06 09:56:51.669 DEBUG 10 --- [uster-worker-20] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 1 successfully opened)
2022-01-06 09:56:51.669 DEBUG 10 --- [uster-worker-20] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 09:57:20.671 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:57:20.673 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:57:25.367 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-36, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:57:25.367 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-36, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 09:57:25.367 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 09:57:25.367 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-36, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:57:25.368 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-36, inFlight=0, closed=true] closing connection
2022-01-06 09:57:25.368 DEBUG 10 --- [uster-worker-21] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 09:57:25.368 DEBUG 10 --- [uster-worker-21] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 09:57:25.368 DEBUG 10 --- [uster-worker-21] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 09:57:25.465 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 09:57:25.465 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 09:57:26.368 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:57:26.370 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-37, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:57:26.371 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-37, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:57:26.371 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-37, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:57:26.371 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-37, inFlight=0, closed=true] closing connection
2022-01-06 09:57:26.371 DEBUG 10 --- [uster-worker-22] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:57:26.372 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 09:57:26.372 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 09:57:26.466 DEBUG 10 --- [uster-worker-21] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:57:28.372 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:57:28.374 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-38, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:57:28.374 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-38, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:57:28.374 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-38, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:57:28.374 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-38, inFlight=0, closed=true] closing connection
2022-01-06 09:57:28.375 DEBUG 10 --- [uster-worker-22] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:57:28.375 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 09:57:28.375 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 09:57:32.375 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:57:32.377 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-39, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:57:32.378 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-39, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:57:32.378 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-39, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:57:32.378 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-39, inFlight=0, closed=true] closing connection
2022-01-06 09:57:32.378 DEBUG 10 --- [uster-worker-21] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:57:32.378 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 09:57:32.379 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 09:57:40.379 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:57:40.383 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-40, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:57:40.384 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-40, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:57:40.384 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-40, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:57:40.384 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-40, inFlight=0, closed=true] closing connection
2022-01-06 09:57:40.385 DEBUG 10 --- [uster-worker-22] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:57:40.385 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 09:57:40.385 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 09:57:55.471 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:57:55.473 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:57:56.386 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:57:56.389 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-41, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:57:56.389 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-41, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:57:56.389 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-41, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:57:56.389 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-41, inFlight=0, closed=true] closing connection
2022-01-06 09:57:56.390 DEBUG 10 --- [uster-worker-21] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:57:56.390 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 09:57:56.390 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 09:58:25.496 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:58:25.499 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:58:28.390 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:58:28.393 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-42, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:58:28.393 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-42, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:58:28.393 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-42, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:58:28.394 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-42, inFlight=0, closed=true] closing connection
2022-01-06 09:58:28.394 DEBUG 10 --- [uster-worker-23] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:58:28.394 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 09:58:28.394 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 09:58:39.849 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:58:39.852 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-44, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 09:58:39.903 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-44, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:58:39.903 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-44, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:58:39.904 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-44, inFlight=0, closed=true] closing connection
2022-01-06 09:58:39.904 DEBUG 10 --- [uster-worker-24] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 09:58:39.904 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-44, inFlight=0, closed=true] has already terminated
2022-01-06 09:58:39.905 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 09:58:39.905 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 512000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 09:58:39.906 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 512000 ms
2022-01-06 09:58:55.510 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:58:55.512 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:59:25.541 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:59:25.544 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 09:59:32.395 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 09:59:32.400 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-43, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 09:59:32.400 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-43, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 09:59:32.400 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-43, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 09:59:32.401 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-43, inFlight=0, closed=true] closing connection
2022-01-06 09:59:32.401 DEBUG 10 --- [uster-worker-25] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 09:59:32.401 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-01-06 09:59:32.401 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 128000 ms
2022-01-06 09:59:55.572 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 09:59:55.575 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:00:25.593 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:00:25.595 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:00:55.623 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:00:55.628 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:01:25.638 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:01:25.640 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:01:40.402 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:01:40.405 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-44, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:01:40.406 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-44, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:01:40.406 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-44, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:01:40.406 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-44, inFlight=0, closed=true] closing connection
2022-01-06 10:01:40.407 DEBUG 10 --- [uster-worker-26] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:01:40.407 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 256000 milliseconds
2022-01-06 10:01:40.407 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 256000 ms
2022-01-06 10:01:55.668 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:01:55.670 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:02:25.697 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:02:25.699 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:02:55.726 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:02:55.729 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:03:25.739 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:03:25.744 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:03:49.059 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 10:03:49.059 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 10:03:50.061 DEBUG 10 --- [uster-worker-27] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 10:03:50.065 DEBUG 10 --- [uster-worker-27] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 10:03:50.065 DEBUG 10 --- [uster-worker-27] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 10:03:50.065 DEBUG 10 --- [uster-worker-27] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 10:03:50.065 DEBUG 10 --- [uster-worker-27] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:03:50.068 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-45, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:04:03.039 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-45, inFlight=0, closed=false] because: [/10.233.68.200:9042] Operation timed out
2022-01-06 10:04:03.039 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-45, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:04:03.040 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-45, inFlight=0, closed=true] closing connection
2022-01-06 10:04:03.040 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.233.68.200:9042-45, inFlight=0, closed=true]: there are still pending requests
2022-01-06 10:04:03.042 DEBUG 10 --- [uster-worker-27] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:04:03.043 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-46, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:04:07.658 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-46, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:04:07.658 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-46, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 10:04:07.658 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-46, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:04:07.658 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-46, inFlight=0, closed=true] closing connection
2022-01-06 10:04:07.658 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Not terminating Connection[/10.233.68.200:9042-46, inFlight=0, closed=true]: there are still pending requests
2022-01-06 10:04:07.659 WARN 10 --- [er-nio-worker-3] c.d.driver.core.HostConnectionPool : Error creating connection to /10.233.68.200:9042
com.datastax.driver.core.exceptions.TransportException: [/10.233.68.200:9042] Connection has been closed
at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1397)
at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1378)
at com.datastax.driver.core.Connection.defunct(Connection.java:570)
at com.datastax.driver.core.Connection$Dispatcher.exceptionCaught(Connection.java:1301)
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:300)
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:279)
at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:271)
at io.netty.channel.DefaultChannelPipeline$HeadContext.exceptionCaught(DefaultChannelPipeline.java:1377)
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:300)
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:279)
at io.netty.channel.DefaultChannelPipeline.fireExceptionCaught(DefaultChannelPipeline.java:907)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.handleReadException(AbstractNioByteChannel.java:125)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:174)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:04:07.659 DEBUG 10 --- [er-nio-worker-3] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 0 successfully opened)
2022-01-06 10:04:07.659 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 10:04:07.660 DEBUG 10 --- [uster-worker-28] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 10:04:07.660 DEBUG 10 --- [uster-worker-28] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 10:04:07.660 DEBUG 10 --- [uster-worker-28] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 10:04:07.660 DEBUG 10 --- [uster-worker-27] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:04:07.961 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 10:04:07.962 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 10:04:08.660 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:04:08.670 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-47, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:04:08.671 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-47, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:04:08.671 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-47, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:04:08.671 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-47, inFlight=0, closed=true] closing connection
2022-01-06 10:04:08.671 DEBUG 10 --- [uster-worker-28] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:04:08.672 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 10:04:08.672 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 10:04:08.962 DEBUG 10 --- [uster-worker-27] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:04:10.672 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:04:10.674 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-48, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:04:10.674 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-48, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:04:10.674 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-48, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:04:10.675 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-48, inFlight=0, closed=true] closing connection
2022-01-06 10:04:10.675 DEBUG 10 --- [uster-worker-28] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:04:10.675 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 10:04:10.675 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 10:04:14.675 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:04:14.677 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-49, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:04:14.677 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-49, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:04:14.677 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-49, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:04:14.678 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-49, inFlight=0, closed=true] closing connection
2022-01-06 10:04:14.678 DEBUG 10 --- [uster-worker-27] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:04:14.678 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 10:04:14.678 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 10:04:22.678 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:04:22.681 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-50, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:04:22.681 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-50, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:04:22.681 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-50, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:04:22.681 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-50, inFlight=0, closed=true] closing connection
2022-01-06 10:04:22.681 DEBUG 10 --- [uster-worker-28] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:04:22.681 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 10:04:22.681 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 10:04:37.976 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:04:38.042 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:04:38.682 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:04:38.684 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-51, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:04:38.684 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-51, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:04:38.684 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-51, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:04:38.684 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-51, inFlight=0, closed=true] closing connection
2022-01-06 10:04:38.685 DEBUG 10 --- [uster-worker-27] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:04:38.685 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 10:04:38.685 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 10:04:40.950 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-46, inFlight=0, closed=true] has already terminated
2022-01-06 10:04:40.950 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-45, inFlight=0, closed=true] has already terminated
2022-01-06 10:05:08.044 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:05:08.048 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:05:10.685 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:05:10.688 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-52, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:05:10.688 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-52, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:05:10.689 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-52, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:05:10.689 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-52, inFlight=0, closed=true] closing connection
2022-01-06 10:05:10.689 DEBUG 10 --- [uster-worker-29] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:05:10.690 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 10:05:10.690 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 10:05:28.142 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 10:05:28.143 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 10:05:29.144 DEBUG 10 --- [uster-worker-30] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 10:05:29.148 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 10:05:29.148 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 10:05:29.148 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 10:05:29.149 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:05:29.151 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-53, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:05:33.652 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-53, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 10:05:34.162 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 0 new connections, total = 1
2022-01-06 10:05:34.163 DEBUG 10 --- [uster-worker-30] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 1 successfully opened)
2022-01-06 10:05:34.163 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 10:05:45.559 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-53, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:05:45.560 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-53, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 10:05:45.560 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 10:05:45.560 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-53, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:05:45.560 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-53, inFlight=0, closed=true] closing connection
2022-01-06 10:05:45.561 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 10:05:45.561 DEBUG 10 --- [uster-worker-31] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 10:05:45.561 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 10:05:45.653 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 10:05:45.654 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 10:05:46.561 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:05:46.564 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-54, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:05:46.565 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-54, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:05:46.565 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-54, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:05:46.565 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-54, inFlight=0, closed=true] closing connection
2022-01-06 10:05:46.565 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:05:46.565 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 10:05:46.565 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 10:05:46.654 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:05:48.565 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:05:48.568 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-55, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:05:48.568 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-55, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:05:48.568 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-55, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:05:48.568 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-55, inFlight=0, closed=true] closing connection
2022-01-06 10:05:48.568 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:05:48.568 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 10:05:48.569 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 10:05:52.569 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:05:52.571 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-56, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:05:52.572 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-56, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:05:52.572 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-56, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:05:52.572 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-56, inFlight=0, closed=true] closing connection
2022-01-06 10:05:52.572 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:05:52.573 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 10:05:52.573 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 10:06:00.573 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:06:00.575 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-57, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:06:00.575 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-57, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:06:00.575 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-57, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:06:00.576 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-57, inFlight=0, closed=true] closing connection
2022-01-06 10:06:00.576 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:06:00.576 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 10:06:00.576 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 10:06:15.671 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:06:15.672 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:06:16.576 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:06:16.579 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-58, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:06:16.579 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-58, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:06:16.579 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-58, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:06:16.579 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-58, inFlight=0, closed=true] closing connection
2022-01-06 10:06:16.579 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:06:16.580 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 10:06:16.580 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 10:06:45.698 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:06:45.700 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:06:48.580 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:06:48.582 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-59, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:06:48.582 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-59, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:06:48.582 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-59, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:06:48.583 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-59, inFlight=0, closed=true] closing connection
2022-01-06 10:06:48.584 DEBUG 10 --- [uster-worker-32] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:06:48.584 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 10:06:48.584 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 10:07:11.907 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:07:11.910 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-45, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:07:11.914 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-45, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 10:07:11.914 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-45, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:07:11.915 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-45, inFlight=0, closed=true] closing connection
2022-01-06 10:07:11.915 DEBUG 10 --- [uster-worker-33] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 10:07:11.916 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-45, inFlight=0, closed=true] has already terminated
2022-01-06 10:07:11.916 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 10:07:11.918 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 600000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:07:11.918 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 600000 ms
2022-01-06 10:07:15.703 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:07:15.705 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:07:45.718 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:07:45.720 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:07:52.584 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:07:52.588 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-60, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:07:52.588 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-60, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:07:52.588 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-60, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:07:52.588 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-60, inFlight=0, closed=true] closing connection
2022-01-06 10:07:52.589 DEBUG 10 --- [uster-worker-34] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:07:52.589 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-01-06 10:07:52.589 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 128000 ms
2022-01-06 10:08:15.749 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:08:15.751 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:08:45.780 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:08:45.782 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:09:15.810 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:09:15.813 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:09:45.825 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:09:45.841 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:10:00.589 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:10:00.592 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-61, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:10:00.592 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-61, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:10:00.593 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-61, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:10:00.593 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-61, inFlight=0, closed=true] closing connection
2022-01-06 10:10:00.594 DEBUG 10 --- [uster-worker-35] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:10:00.594 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 256000 milliseconds
2022-01-06 10:10:00.594 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 256000 ms
2022-01-06 10:10:15.855 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:10:15.857 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:10:45.885 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:10:45.887 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:11:15.916 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:11:15.918 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:11:45.947 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:11:45.950 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:11:53.964 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 10:11:53.965 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 10:11:54.966 DEBUG 10 --- [uster-worker-36] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 10:11:54.974 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 10:11:54.974 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 10:11:54.974 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 10:11:54.974 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:11:54.977 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-62, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:12:07.839 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-62, inFlight=0, closed=false] because: [/10.233.68.200:9042] Operation timed out
2022-01-06 10:12:07.839 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-62, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:12:07.840 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-62, inFlight=0, closed=true] closing connection
2022-01-06 10:12:07.840 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.233.68.200:9042-62, inFlight=0, closed=true]: there are still pending requests
2022-01-06 10:12:07.841 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:12:07.842 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-63, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:12:13.151 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-63, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 10:12:13.152 DEBUG 10 --- [er-nio-worker-3] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 1 successfully opened)
2022-01-06 10:12:13.152 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 10:12:13.152 DEBUG 10 --- [uster-worker-37] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 10:12:13.152 DEBUG 10 --- [uster-worker-37] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-63, inFlight=0, closed=true] closing connection
2022-01-06 10:12:13.152 DEBUG 10 --- [uster-worker-37] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-63, inFlight=0, closed=true] closed, remaining = 0
2022-01-06 10:12:13.153 DEBUG 10 --- [uster-worker-37] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 10:12:13.153 DEBUG 10 --- [uster-worker-37] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 10:12:14.153 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:12:14.155 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-64, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:12:17.450 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-64, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 10:12:17.450 DEBUG 10 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 10:12:17.455 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Successful reconnection to /10.233.68.200:9042, setting host UP
2022-01-06 10:12:17.455 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 10:12:17.455 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 10:12:17.455 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 10:12:17.656 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 0 new connections, total = 1
2022-01-06 10:12:17.656 DEBUG 10 --- [-reconnection-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 1 successfully opened)
2022-01-06 10:12:17.656 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 10:12:17.657 DEBUG 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2022-01-06 10:12:25.955 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-64, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:12:25.956 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-64, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 10:12:25.956 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 10:12:25.956 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-64, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:12:25.956 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-64, inFlight=0, closed=true] closing connection
2022-01-06 10:12:25.956 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 10:12:25.957 DEBUG 10 --- [uster-worker-36] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 10:12:25.957 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 10:12:26.056 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 10:12:26.056 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 10:12:26.957 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:12:26.959 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-65, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:12:26.959 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-65, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:12:26.959 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-65, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:12:26.959 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-65, inFlight=0, closed=true] closing connection
2022-01-06 10:12:26.959 DEBUG 10 --- [uster-worker-37] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:12:26.960 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 10:12:26.960 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 10:12:27.056 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:12:28.960 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:12:28.962 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-66, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:12:28.962 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-66, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:12:28.963 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-66, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:12:28.963 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-66, inFlight=0, closed=true] closing connection
2022-01-06 10:12:28.963 DEBUG 10 --- [uster-worker-37] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:12:28.963 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 10:12:28.963 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 10:12:32.964 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:12:32.966 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-67, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:12:32.966 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-67, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:12:32.966 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-67, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:12:32.966 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-67, inFlight=0, closed=true] closing connection
2022-01-06 10:12:32.966 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:12:32.966 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 10:12:32.966 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 10:12:40.956 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-62, inFlight=0, closed=true] has already terminated
2022-01-06 10:12:40.967 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:12:40.969 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-68, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:12:40.970 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-68, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:12:40.970 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-68, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:12:40.970 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-68, inFlight=0, closed=true] closing connection
2022-01-06 10:12:40.970 DEBUG 10 --- [uster-worker-37] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:12:40.970 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 10:12:40.970 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 10:12:56.062 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:12:56.064 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:12:56.970 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:12:56.972 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-69, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:12:56.973 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-69, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:12:56.973 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-69, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:12:56.973 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-69, inFlight=0, closed=true] closing connection
2022-01-06 10:12:56.973 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:12:56.973 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 10:12:56.973 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 10:13:26.092 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:13:26.094 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:13:28.974 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:13:28.978 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-70, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:13:28.978 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-70, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:13:28.978 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-70, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:13:28.979 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-70, inFlight=0, closed=true] closing connection
2022-01-06 10:13:28.979 DEBUG 10 --- [uster-worker-38] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:13:28.979 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 10:13:28.979 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 10:13:56.112 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:13:56.114 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:14:26.143 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:14:26.145 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:14:32.980 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:14:32.982 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-71, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:14:32.982 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-71, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:14:32.982 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-71, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:14:32.983 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-71, inFlight=0, closed=true] closing connection
2022-01-06 10:14:32.983 DEBUG 10 --- [uster-worker-39] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:14:32.983 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-01-06 10:14:32.983 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 128000 ms
2022-01-06 10:14:56.160 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:14:56.162 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:15:26.164 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:15:26.166 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:15:56.195 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:15:56.199 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:16:26.210 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:16:26.213 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:16:40.983 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:16:40.987 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-72, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:16:40.987 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-72, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:16:40.987 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-72, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:16:40.988 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-72, inFlight=0, closed=true] closing connection
2022-01-06 10:16:40.988 DEBUG 10 --- [uster-worker-40] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:16:40.988 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 256000 milliseconds
2022-01-06 10:16:40.988 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 256000 ms
2022-01-06 10:16:56.239 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:16:56.241 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:17:11.918 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:17:11.921 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-46, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:17:11.991 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-46, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 10:17:11.991 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-46, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:17:11.991 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-46, inFlight=0, closed=true] closing connection
2022-01-06 10:17:11.992 DEBUG 10 --- [uster-worker-41] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 10:17:11.992 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-46, inFlight=0, closed=true] has already terminated
2022-01-06 10:17:11.992 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 10:17:11.993 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 600000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:17:11.994 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 600000 ms
2022-01-06 10:17:26.254 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:17:26.257 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:17:56.258 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:17:56.260 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:18:26.289 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:18:26.291 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:18:56.299 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:18:56.301 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:19:26.329 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:19:26.331 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:19:56.353 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:19:56.355 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:20:26.384 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:20:26.387 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:20:31.758 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 10:20:31.759 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 10:20:32.760 DEBUG 10 --- [uster-worker-42] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 10:20:32.766 DEBUG 10 --- [uster-worker-42] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 10:20:32.766 DEBUG 10 --- [uster-worker-42] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 10:20:32.766 DEBUG 10 --- [uster-worker-42] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 10:20:32.766 DEBUG 10 --- [uster-worker-42] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:20:32.770 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-73, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:20:37.052 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-73, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 10:20:37.266 DEBUG 10 --- [uster-worker-42] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 0 new connections, total = 1
2022-01-06 10:20:37.267 DEBUG 10 --- [uster-worker-42] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 1 successfully opened)
2022-01-06 10:20:37.267 DEBUG 10 --- [uster-worker-42] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 10:20:45.462 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-73, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:20:45.462 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-73, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 10:20:45.462 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 10:20:45.462 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-73, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:20:45.463 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-73, inFlight=0, closed=true] closing connection
2022-01-06 10:20:45.463 DEBUG 10 --- [uster-worker-43] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 10:20:45.463 DEBUG 10 --- [uster-worker-43] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 10:20:45.463 DEBUG 10 --- [uster-worker-43] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 10:20:45.564 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 10:20:45.564 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 10:20:46.463 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:20:46.466 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-74, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:20:46.467 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-74, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:20:46.467 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-74, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:20:46.467 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-74, inFlight=0, closed=true] closing connection
2022-01-06 10:20:46.467 DEBUG 10 --- [uster-worker-42] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:20:46.467 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 10:20:46.467 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 10:20:46.565 DEBUG 10 --- [uster-worker-43] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:20:48.468 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:20:48.469 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-75, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:20:48.470 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-75, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:20:48.470 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-75, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:20:48.470 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-75, inFlight=0, closed=true] closing connection
2022-01-06 10:20:48.470 DEBUG 10 --- [uster-worker-42] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:20:48.470 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 10:20:48.470 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 10:20:52.471 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:20:52.473 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-76, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:20:52.473 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-76, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:20:52.473 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-76, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:20:52.473 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-76, inFlight=0, closed=true] closing connection
2022-01-06 10:20:52.473 DEBUG 10 --- [uster-worker-43] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:20:52.474 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 10:20:52.474 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 10:21:00.474 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:21:00.477 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-77, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:21:00.477 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-77, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:21:00.477 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-77, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:21:00.477 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-77, inFlight=0, closed=true] closing connection
2022-01-06 10:21:00.477 DEBUG 10 --- [uster-worker-42] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:21:00.477 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 10:21:00.477 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 10:21:15.584 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:21:15.586 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:21:16.478 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:21:16.480 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-78, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:21:16.481 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-78, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:21:16.481 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-78, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:21:16.481 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-78, inFlight=0, closed=true] closing connection
2022-01-06 10:21:16.481 DEBUG 10 --- [uster-worker-43] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:21:16.481 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 10:21:16.481 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 10:21:45.614 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:21:45.616 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:21:48.481 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:21:48.483 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-79, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:21:48.484 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-79, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:21:48.484 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-79, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:21:48.484 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-79, inFlight=0, closed=true] closing connection
2022-01-06 10:21:48.484 DEBUG 10 --- [uster-worker-44] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:21:48.484 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 10:21:48.484 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 10:22:02.759 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 10:22:02.759 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 10:22:03.761 DEBUG 10 --- [uster-worker-45] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 10:22:03.845 DEBUG 10 --- [uster-worker-45] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 10:22:03.845 DEBUG 10 --- [uster-worker-45] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 10:22:03.845 DEBUG 10 --- [uster-worker-45] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 10:22:03.845 DEBUG 10 --- [uster-worker-45] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:22:03.848 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-80, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:22:06.455 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-80, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:22:06.456 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-80, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 10:22:06.456 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-80, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:22:06.456 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-80, inFlight=0, closed=true] closing connection
2022-01-06 10:22:06.456 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Not terminating Connection[/10.233.68.200:9042-80, inFlight=0, closed=true]: there are still pending requests
2022-01-06 10:22:06.456 DEBUG 10 --- [uster-worker-45] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:22:06.458 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-81, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:22:06.458 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-81, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:22:06.459 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-81, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:22:06.459 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-81, inFlight=0, closed=true] closing connection
2022-01-06 10:22:06.460 WARN 10 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Error creating connection to /10.233.68.200:9042
com.datastax.driver.core.exceptions.TransportException: [/10.233.68.200:9042] Cannot connect
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:224)
at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:194)
at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:577)
at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:570)
at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:549)
at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:490)
at io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:615)
at io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:608)
at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:321)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:337)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:702)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: /10.233.68.200:9042
Caused by: java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:330)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:702)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:22:06.461 DEBUG 10 --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 0 successfully opened)
2022-01-06 10:22:06.461 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 10:22:06.461 DEBUG 10 --- [uster-worker-44] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 10:22:06.462 DEBUG 10 --- [uster-worker-44] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 10:22:06.462 DEBUG 10 --- [uster-worker-44] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 10:22:06.462 DEBUG 10 --- [uster-worker-45] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:22:06.761 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 10:22:06.761 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 10:22:07.462 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:22:07.465 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-82, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:22:07.466 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-82, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:22:07.466 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-82, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:22:07.466 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-82, inFlight=0, closed=true] closing connection
2022-01-06 10:22:07.466 DEBUG 10 --- [uster-worker-44] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:22:07.466 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 10:22:07.466 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 10:22:07.762 DEBUG 10 --- [uster-worker-45] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:22:09.467 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:22:09.468 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-83, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:22:09.469 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-83, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:22:09.469 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-83, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:22:09.469 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-83, inFlight=0, closed=true] closing connection
2022-01-06 10:22:09.469 DEBUG 10 --- [uster-worker-44] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:22:09.469 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 10:22:09.469 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 10:22:13.470 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:22:13.472 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-84, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:22:13.472 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-84, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:22:13.472 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-84, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:22:13.472 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-84, inFlight=0, closed=true] closing connection
2022-01-06 10:22:13.472 DEBUG 10 --- [uster-worker-45] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:22:13.472 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 10:22:13.472 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 10:22:21.473 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:22:21.475 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-85, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:22:21.475 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-85, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:22:21.475 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-85, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:22:21.475 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-85, inFlight=0, closed=true] closing connection
2022-01-06 10:22:21.475 DEBUG 10 --- [uster-worker-44] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:22:21.475 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 10:22:21.475 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 10:22:36.783 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:22:36.840 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:22:37.476 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:22:37.478 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-86, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:22:37.478 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-86, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:22:37.478 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-86, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:22:37.478 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-86, inFlight=0, closed=true] closing connection
2022-01-06 10:22:37.478 DEBUG 10 --- [uster-worker-45] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:22:37.478 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 10:22:37.478 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 10:22:40.964 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-80, inFlight=0, closed=true] has already terminated
2022-01-06 10:23:06.841 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:23:06.842 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:23:09.479 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:23:09.481 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-87, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:23:09.482 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-87, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:23:09.482 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-87, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:23:09.482 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-87, inFlight=0, closed=true] closing connection
2022-01-06 10:23:09.482 DEBUG 10 --- [uster-worker-46] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:23:09.483 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 10:23:09.483 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 10:23:36.871 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:23:36.874 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:24:06.874 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:24:06.876 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:24:13.483 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:24:13.486 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-88, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:24:13.486 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-88, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:24:13.486 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-88, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:24:13.487 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-88, inFlight=0, closed=true] closing connection
2022-01-06 10:24:13.487 DEBUG 10 --- [uster-worker-47] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:24:13.487 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-01-06 10:24:13.487 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 128000 ms
2022-01-06 10:24:36.877 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:24:36.879 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:25:06.897 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:25:06.900 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:25:36.927 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:25:36.940 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:26:06.958 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:26:06.960 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:26:21.488 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:26:21.492 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-89, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:26:21.493 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-89, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:26:21.493 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-89, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:26:21.494 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-89, inFlight=0, closed=true] closing connection
2022-01-06 10:26:21.494 DEBUG 10 --- [uster-worker-48] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:26:21.495 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 256000 milliseconds
2022-01-06 10:26:21.495 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 256000 ms
2022-01-06 10:26:36.989 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:26:37.040 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:27:07.041 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:27:07.043 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:27:11.994 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:27:11.997 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-47, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:27:12.001 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.66.95:9042-47, inFlight=0, closed=false] because: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 10:27:12.001 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] Connection[/10.233.66.95:9042-47, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:27:12.001 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-47, inFlight=0, closed=true] closing connection
2022-01-06 10:27:12.001 DEBUG 10 --- [uster-worker-49] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.66.95:9042
2022-01-06 10:27:12.002 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.66.95:9042-47, inFlight=0, closed=true] has already terminated
2022-01-06 10:27:12.002 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-01-06 10:27:12.003 ERROR 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.233.66.95:9042, scheduling retry in 600000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.233.66.95:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442)
at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433)
at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408)
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:27:12.003 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.66.95:9042] next reconnection attempt in 600000 ms
2022-01-06 10:27:37.067 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:27:37.069 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:28:07.070 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:28:07.072 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:28:29.057 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 10:28:29.057 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 10:28:30.058 DEBUG 10 --- [uster-worker-50] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 10:28:30.063 DEBUG 10 --- [uster-worker-50] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 10:28:30.063 DEBUG 10 --- [uster-worker-50] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 10:28:30.063 DEBUG 10 --- [uster-worker-50] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 10:28:30.064 DEBUG 10 --- [uster-worker-50] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:28:30.066 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-90, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:28:34.567 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-90, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 10:28:34.861 DEBUG 10 --- [uster-worker-50] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 0 new connections, total = 1
2022-01-06 10:28:34.861 DEBUG 10 --- [uster-worker-50] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 1 successfully opened)
2022-01-06 10:28:34.862 DEBUG 10 --- [uster-worker-50] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 10:28:45.353 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 10:28:45.353 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 10:28:45.353 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-90, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:28:45.354 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-90, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 10:28:45.354 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 10:28:45.354 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-90, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:28:45.354 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-90, inFlight=0, closed=true] closing connection
2022-01-06 10:28:45.354 DEBUG 10 --- [uster-worker-51] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 10:28:45.355 DEBUG 10 --- [uster-worker-51] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 10:28:45.355 DEBUG 10 --- [uster-worker-51] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 10:28:46.353 DEBUG 10 --- [uster-worker-50] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:28:46.355 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:28:46.358 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-91, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:28:46.358 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-91, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:28:46.358 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-91, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:28:46.358 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-91, inFlight=0, closed=true] closing connection
2022-01-06 10:28:46.359 DEBUG 10 --- [uster-worker-51] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:28:46.359 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 10:28:46.359 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 10:28:48.359 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:28:48.362 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-92, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:28:48.362 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-92, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:28:48.362 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-92, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:28:48.362 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-92, inFlight=0, closed=true] closing connection
2022-01-06 10:28:48.362 DEBUG 10 --- [uster-worker-50] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:28:48.362 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 10:28:48.362 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 10:28:52.363 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:28:52.365 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-93, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:28:52.365 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-93, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:28:52.365 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-93, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:28:52.365 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-93, inFlight=0, closed=true] closing connection
2022-01-06 10:28:52.365 DEBUG 10 --- [uster-worker-51] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:28:52.365 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 10:28:52.365 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 10:29:00.366 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:29:00.369 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-94, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:29:00.369 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-94, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:29:00.369 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-94, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:29:00.369 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-94, inFlight=0, closed=true] closing connection
2022-01-06 10:29:00.369 DEBUG 10 --- [uster-worker-50] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:29:00.370 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 10:29:00.370 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 10:29:15.366 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:29:15.368 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:29:16.370 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:29:16.372 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-95, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:29:16.372 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-95, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:29:16.372 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-95, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:29:16.372 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-95, inFlight=0, closed=true] closing connection
2022-01-06 10:29:16.372 DEBUG 10 --- [uster-worker-51] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:29:16.372 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 10:29:16.372 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 10:29:45.395 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:29:45.400 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:29:48.373 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:29:48.376 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-96, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:29:48.376 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-96, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:29:48.376 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-96, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:29:48.377 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-96, inFlight=0, closed=true] closing connection
2022-01-06 10:29:48.377 DEBUG 10 --- [uster-worker-52] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:29:48.378 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 10:29:48.378 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 10:30:07.564 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.68.200:9042, scheduling delivery
2022-01-06 10:30:07.565 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event UP
2022-01-06 10:30:08.566 DEBUG 10 --- [uster-worker-53] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.68.200:9042
2022-01-06 10:30:08.570 DEBUG 10 --- [uster-worker-53] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host UP
2022-01-06 10:30:08.570 DEBUG 10 --- [uster-worker-53] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-01-06 10:30:08.570 DEBUG 10 --- [uster-worker-53] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.68.200:9042
2022-01-06 10:30:08.571 DEBUG 10 --- [uster-worker-53] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:30:08.573 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-97, inFlight=0, closed=false] Connection established, initializing transport
2022-01-06 10:30:15.059 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-97, inFlight=0, closed=false] Transport initialized, connection ready
2022-01-06 10:30:15.654 DEBUG 10 --- [uster-worker-53] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 0 new connections, total = 1
2022-01-06 10:30:15.654 DEBUG 10 --- [uster-worker-53] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.68.200:9042 (1 connections needed, 1 successfully opened)
2022-01-06 10:30:15.654 DEBUG 10 --- [uster-worker-53] com.datastax.driver.core.Session : Added connection pool for /10.233.68.200:9042
2022-01-06 10:30:25.859 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-97, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-01-06 10:30:25.860 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-97, inFlight=0, closed=false] because: [/10.233.68.200:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-01-06 10:30:25.860 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preventing new connections for the next 1000 ms
2022-01-06 10:30:25.860 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-97, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:30:25.860 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-97, inFlight=0, closed=true] closing connection
2022-01-06 10:30:25.860 DEBUG 10 --- [uster-worker-54] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] marking host DOWN
2022-01-06 10:30:25.861 DEBUG 10 --- [uster-worker-54] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-01-06 10:30:25.861 DEBUG 10 --- [uster-worker-54] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] starting reconnection attempt
2022-01-06 10:30:26.056 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.68.200:9042, scheduling delivery
2022-01-06 10:30:26.056 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] received event DOWN
2022-01-06 10:30:26.861 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:30:26.863 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-98, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:30:26.864 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-98, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:30:26.864 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-98, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:30:26.864 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-98, inFlight=0, closed=true] closing connection
2022-01-06 10:30:26.864 DEBUG 10 --- [uster-worker-53] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:30:26.864 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-01-06 10:30:26.864 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 2000 ms
2022-01-06 10:30:27.057 DEBUG 10 --- [uster-worker-54] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:30:28.865 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:30:28.867 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-99, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:30:28.868 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-99, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:30:28.868 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-99, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:30:28.868 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-99, inFlight=0, closed=true] closing connection
2022-01-06 10:30:28.868 DEBUG 10 --- [uster-worker-53] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:30:28.868 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-01-06 10:30:28.868 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 4000 ms
2022-01-06 10:30:32.868 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:30:32.870 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-100, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:30:32.871 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-100, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:30:32.871 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-100, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:30:32.871 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-100, inFlight=0, closed=true] closing connection
2022-01-06 10:30:32.871 DEBUG 10 --- [uster-worker-54] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:30:32.871 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-01-06 10:30:32.871 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 8000 ms
2022-01-06 10:30:40.871 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:30:40.874 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-101, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:30:40.874 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-101, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:30:40.874 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-101, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:30:40.874 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-101, inFlight=0, closed=true] closing connection
2022-01-06 10:30:40.874 DEBUG 10 --- [uster-worker-53] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:30:40.875 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-01-06 10:30:40.875 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 16000 ms
2022-01-06 10:30:56.057 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:30:56.059 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:30:56.875 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:30:56.877 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-102, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:30:56.877 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-102, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:30:56.877 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-102, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:30:56.877 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-102, inFlight=0, closed=true] closing connection
2022-01-06 10:30:56.877 DEBUG 10 --- [uster-worker-54] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:30:56.878 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-01-06 10:30:56.878 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 32000 ms
2022-01-06 10:31:26.083 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:31:26.085 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:31:28.878 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:31:28.881 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-103, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:31:28.881 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-103, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:31:28.881 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-103, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:31:28.882 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-103, inFlight=0, closed=true] closing connection
2022-01-06 10:31:28.882 DEBUG 10 --- [uster-worker-55] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:31:28.882 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-01-06 10:31:28.882 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 64000 ms
2022-01-06 10:31:56.111 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:31:56.113 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:32:26.141 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:32:26.143 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:32:32.883 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] preparing to open 1 new connections, total = 1
2022-01-06 10:32:32.885 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-104, inFlight=0, closed=false] Error connecting to /10.233.68.200:9042 (Connection refused: /10.233.68.200:9042)
2022-01-06 10:32:32.885 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.68.200:9042-104, inFlight=0, closed=false] because: [/10.233.68.200:9042] Cannot connect
2022-01-06 10:32:32.885 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] Connection[/10.233.68.200:9042-104, inFlight=0, closed=false] failed, remaining = 0
2022-01-06 10:32:32.885 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.68.200:9042-104, inFlight=0, closed=true] closing connection
2022-01-06 10:32:32.886 DEBUG 10 --- [uster-worker-56] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.68.200:9042
2022-01-06 10:32:32.886 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.68.200:9042 ([/10.233.68.200:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-01-06 10:32:32.886 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.68.200:9042] next reconnection attempt in 128000 ms
2022-01-06 10:32:56.172 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:32:56.175 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-01-06 10:33:26.202 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-01-06 10:33:26.205 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.71.39:9042-1, inFlight=0, closed=false] heartbeat query succeeded