By type
*** retrieve Truststore and Keystore password
*** actual launch of AAI Resources
2022-03-21 03:39:37.992 INFO --- [ main] org.onap.aai.util.AAIConfig : Initializing AAIConfig
2022-03-21 03:39:38.001 DEBUG --- [ main] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2022-03-21 03:39:38.002 INFO --- [ main] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2022-03-21 03:39:38.005 INFO --- [ main] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename
2022-03-21 03:39:40.795 WARN 10 --- [ main] o.s.b.l.logback.LogbackLoggingSystem : Ignoring 'logback.configurationFile' system property. Please use 'logging.config' instead.
. ____ _ __ _ _
/\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
\\/ ___)| |_)| | | | | || (_| | ) ) ) )
' |____| .__|_| |_|_| |_\__, | / / / /
=========|_|==============|___/=/_/_/_/
:: Spring Boot :: (v2.1.12.RELEASE)
03:39:50,770 |-INFO in LogbackRequestLog - Will use configuration resource [/localhost-access-logback.xml]
03:39:50,778 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - debug attribute not set
03:39:50,778 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
03:39:50,778 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [ACCESS]
03:39:50,780 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@795326519 - No compression will be used
03:39:50,780 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@795326519 - Will use the pattern /opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd} for the active file
03:39:50,780 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - The date pattern is 'yyyy-MM-dd' from file name pattern '/opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log.%d{yyyy-MM-dd}'.
03:39:50,780 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Roll-over at midnight.
03:39:50,780 |-INFO in c.q.l.core.rolling.DefaultTimeBasedFileNamingAndTriggeringPolicy - Setting initial period to Mon Mar 21 03:37:06 GMT 2022
03:39:50,800 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - Active log file name: /opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log
03:39:50,800 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ACCESS] - File property is set to [/opt/app/aai-traversal/logs/ajsc-jetty/localhost_access.log]
03:39:50,801 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [ACCESS] to null
03:39:50,801 |-INFO in ch.qos.logback.access.joran.action.ConfigurationAction - End of configuration.
03:39:50,801 |-INFO in ch.qos.logback.access.joran.JoranConfigurator@1869fbd2 - Registering current configuration as safe fallback point
2022-03-21 03:39:51.070 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED CLASSES [class org.onap.aai.rest.CQ2GremlinTest, class org.onap.aai.rest.CQ2Gremlin, class org.onap.aai.rest.search.ModelAndNamedQueryRestProvider, class org.onap.aai.rest.QueryConsumer, class org.onap.aai.rest.util.EchoResponse, class org.onap.aai.rest.search.SearchProvider, class org.onap.aai.rest.RecentAPIConsumer, class org.onap.aai.rest.DslConsumer]
2022-03-21 03:39:51.076 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseTransactionLogging result=true
2022-03-21 03:39:51.077 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestHeaderManipulation result=true
2022-03-21 03:39:51.078 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionInterceptor result=true
2022-03-21 03:39:51.078 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HttpHeaderInterceptor result=true
2022-03-21 03:39:51.079 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.OneWaySslAuthorization result=true
2022-03-21 03:39:51.080 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HeaderValidation result=true
2022-03-21 03:39:51.080 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseHeaderManipulation result=true
2022-03-21 03:39:51.081 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionLatestInterceptor result=true
2022-03-21 03:39:51.082 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.InvalidResponseStatus result=true
2022-03-21 03:39:51.082 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestTransactionLogging result=true
2022-03-21 03:39:51.083 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestModification result=true
2022-03-21 03:39:51.083 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RetiredInterceptor result=true
2022-03-21 03:39:51.088 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseTransactionLogging result=true
2022-03-21 03:39:51.089 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestHeaderManipulation result=true
2022-03-21 03:39:51.089 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionInterceptor result=true
2022-03-21 03:39:51.090 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HttpHeaderInterceptor result=true
2022-03-21 03:39:51.090 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.OneWaySslAuthorization result=true
2022-03-21 03:39:51.091 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.HeaderValidation result=true
2022-03-21 03:39:51.092 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.ResponseHeaderManipulation result=true
2022-03-21 03:39:51.092 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.VersionLatestInterceptor result=true
2022-03-21 03:39:51.093 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.post.InvalidResponseStatus result=true
2022-03-21 03:39:51.093 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestTransactionLogging result=true
2022-03-21 03:39:51.094 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RequestModification result=true
2022-03-21 03:39:51.095 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : isEnabledByActiveProfiles: annotatedElement: class org.onap.aai.interceptors.pre.RetiredInterceptor result=true
2022-03-21 03:39:51.095 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.post.InvalidResponseStatus
2022-03-21 03:39:51.096 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RequestTransactionLogging
2022-03-21 03:39:51.096 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.HeaderValidation
2022-03-21 03:39:51.097 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.post.ResponseTransactionLogging
2022-03-21 03:39:51.098 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.HttpHeaderInterceptor
2022-03-21 03:39:51.098 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.post.ResponseHeaderManipulation
2022-03-21 03:39:51.099 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.VersionLatestInterceptor
2022-03-21 03:39:51.099 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.OneWaySslAuthorization
2022-03-21 03:39:51.100 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RetiredInterceptor
2022-03-21 03:39:51.100 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.VersionInterceptor
2022-03-21 03:39:51.101 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RequestHeaderManipulation
2022-03-21 03:39:51.101 DEBUG 10 --- [ main] org.onap.aai.web.JerseyConfiguration : REGISTERED FILTERS org.onap.aai.interceptors.pre.RequestModification
2022-03-21 03:39:51.598 DEBUG 10 --- [ main] i.m.c.u.i.logging.InternalLoggerFactory : Using SLF4J as the default logging framework
2022-03-21 03:39:54.033 INFO 10 --- [ main] org.onap.aai.config.NodesConfiguration : Translator is SchemaServiceTranslator
2022-03-21 03:39:54.574 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:39:54.574 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:39:54.574 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:39:54.578 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:39:54.583 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/versions, BODY=
2022-03-21 03:39:54.810 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:39:54.810 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:39:54.810 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:39:54.813 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:39:55.554 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:39:55.704 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Processing the translator
2022-03-21 03:39:55.704 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv11
2022-03-21 03:39:55.705 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:39:55.904 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:39:55.905 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:39:55.905 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:39:55.905 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:39:55.976 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:39:56.108 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:39:56.109 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:39:56.109 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:02.676 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 222
2022-03-21 03:40:02.727 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv12
2022-03-21 03:40:02.728 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:02.733 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:02.734 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:02.734 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:02.734 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:02.804 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:02.930 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:02.931 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:02.932 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:06.112 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 235
2022-03-21 03:40:06.195 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv13
2022-03-21 03:40:06.196 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:06.199 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:06.199 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:06.199 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:06.199 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:06.235 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:06.374 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:06.376 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:06.376 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:08.881 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 237
2022-03-21 03:40:08.915 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv14
2022-03-21 03:40:08.916 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:08.920 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:08.920 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:08.921 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:08.921 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:08.948 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:09.001 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:09.002 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:09.007 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:11.627 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 272
2022-03-21 03:40:11.685 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv15
2022-03-21 03:40:11.687 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:11.689 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:11.689 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:11.690 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:11.690 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:11.718 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:11.776 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:11.777 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:11.778 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:14.550 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 279
2022-03-21 03:40:14.570 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv16
2022-03-21 03:40:14.572 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:14.577 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:14.577 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:14.577 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:14.577 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:14.607 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:14.642 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:14.643 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:14.643 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:16.733 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2022-03-21 03:40:16.775 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv17
2022-03-21 03:40:16.776 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:16.778 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:16.778 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:16.779 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:16.779 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:16.803 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:16.829 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:16.829 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:16.830 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:19.210 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2022-03-21 03:40:19.229 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv18
2022-03-21 03:40:19.230 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:19.234 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:19.267 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:19.268 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:19.268 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:19.307 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:19.372 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:19.373 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:19.374 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:21.855 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281
2022-03-21 03:40:21.867 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv19
2022-03-21 03:40:21.868 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:21.871 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:21.871 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:21.871 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:21.871 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:21.894 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:21.919 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:21.920 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:21.920 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:24.313 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 301
2022-03-21 03:40:24.328 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv20
2022-03-21 03:40:24.329 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:24.331 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:24.331 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:24.332 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:24.332 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:24.369 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:24.398 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:24.400 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:24.400 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:26.971 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 305
2022-03-21 03:40:26.982 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv21
2022-03-21 03:40:26.983 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:26.987 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:26.987 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:26.987 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:26.987 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:27.017 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:27.050 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:27.051 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:27.052 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:29.543 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 371
2022-03-21 03:40:29.557 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv22
2022-03-21 03:40:29.558 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:29.561 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:29.561 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:29.561 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:29.561 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:29.589 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:29.624 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:29.625 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:29.626 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:32.288 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378
2022-03-21 03:40:32.305 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv23
2022-03-21 03:40:32.306 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:32.309 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:32.309 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:32.309 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:32.309 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:32.371 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:32.418 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:32.419 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:32.419 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:35.449 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378
2022-03-21 03:40:35.464 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv24
2022-03-21 03:40:35.465 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml}
2022-03-21 03:40:35.468 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:40:35.468 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:40:35.468 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:40:35.468 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:40:35.493 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:40:35.534 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:40:35.535 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService
2022-03-21 03:40:35.535 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream
2022-03-21 03:40:38.755 DEBUG 10 --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 406
2022-03-21 03:40:38.790 DEBUG 10 --- [ main] org.onap.aai.TraversalApp : AAI Server initialization started...
2022-03-21 03:40:38.791 DEBUG 10 --- [ main] org.onap.aai.TraversalApp : Starting AAIGraph connections and the NodeInjestor
2022-03-21 03:40:38.791 INFO 10 --- [ main] org.onap.aai.util.AAIConfig : Initializing AAIConfig
2022-03-21 03:40:38.791 DEBUG 10 --- [ main] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2022-03-21 03:40:38.792 INFO 10 --- [ main] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-traversal/./resources/etc/appprops/aaiconfig.properties
2022-03-21 03:40:38.792 INFO 10 --- [ main] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename
2022-03-21 03:40:39.473 INFO 10 --- [ main] com.datastax.driver.core : DataStax Java driver 3.6.0 for Apache Cassandra
2022-03-21 03:40:39.486 INFO 10 --- [ main] c.d.driver.core.GuavaCompatibility : Detected Guava >= 19 in the classpath, using modern compatibility layer
2022-03-21 03:40:39.487 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NEW_NODE_DELAY_SECONDS is undefined, using default value 1
2022-03-21 03:40:39.488 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NOTIF_LOCK_TIMEOUT_SECONDS is undefined, using default value 60
2022-03-21 03:40:39.519 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2022-03-21 03:40:39.921 INFO 10 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2022-03-21 03:40:39.934 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NON_BLOCKING_EXECUTOR_SIZE is undefined, using default value 2
2022-03-21 03:40:40.069 DEBUG 10 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.233.70.52:9042]
2022-03-21 03:40:40.126 DEBUG 10 --- [ main] i.n.u.i.logging.InternalLoggerFactory : Using SLF4J as the default logging framework
2022-03-21 03:40:40.155 DEBUG 10 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024
2022-03-21 03:40:40.156 DEBUG 10 --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096
2022-03-21 03:40:40.214 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : -Dio.netty.noUnsafe: false
2022-03-21 03:40:40.214 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : Java version: 8
2022-03-21 03:40:40.217 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.theUnsafe: available
2022-03-21 03:40:40.218 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.copyMemory: available
2022-03-21 03:40:40.219 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Buffer.address: available
2022-03-21 03:40:40.220 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : direct buffer constructor: available
2022-03-21 03:40:40.223 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Bits.unaligned: available, true
2022-03-21 03:40:40.223 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9
2022-03-21 03:40:40.223 DEBUG 10 --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.DirectByteBuffer.(long, int): available
2022-03-21 03:40:40.223 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : sun.misc.Unsafe: available
2022-03-21 03:40:40.224 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
2022-03-21 03:40:40.224 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.bitMode: 64 (sun.arch.data.model)
2022-03-21 03:40:40.227 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.maxDirectMemory: 1020067840 bytes
2022-03-21 03:40:40.227 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.uninitializedArrayAllocationThreshold: -1
2022-03-21 03:40:40.230 DEBUG 10 --- [ main] io.netty.util.internal.CleanerJava6 : java.nio.ByteBuffer.cleaner(): available
2022-03-21 03:40:40.230 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.noPreferDirect: false
2022-03-21 03:40:40.248 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FORCE_NIO is undefined, using default value false
2022-03-21 03:40:40.267 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.workdir: /tmp (io.netty.tmpdir)
2022-03-21 03:40:40.268 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.deleteLibAfterLoading: true
2022-03-21 03:40:40.268 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.tryPatchShadedId: true
2022-03-21 03:40:40.278 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library 'netty_transport_native_epoll_x86_64', trying other loading mechanism.
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:290)
at io.netty.channel.epoll.Native.(Native.java:70)
at io.netty.channel.epoll.Epoll.(Epoll.java:39)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
2022-03-21 03:40:40.279 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : netty_transport_native_epoll_x86_64 cannot be loaded from java.library.path, now trying export to -Dio.netty.native.workdir: /tmp
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:290)
at io.netty.channel.epoll.Native.(Native.java:70)
at io.netty.channel.epoll.Epoll.(Epoll.java:39)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
2022-03-21 03:40:40.310 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library '/tmp/libnetty_transport_native_epoll_x86_646999333421220599529.so', trying other loading mechanism.
java.lang.UnsatisfiedLinkError: unsupported JNI version 0xFFFFFFFF required by /tmp/libnetty_transport_native_epoll_x86_646999333421220599529.so
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:36)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:203)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:290)
at io.netty.channel.epoll.Native.(Native.java:70)
at io.netty.channel.epoll.Epoll.(Epoll.java:39)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
2022-03-21 03:40:40.318 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library 'netty_transport_native_epoll', trying other loading mechanism.
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:293)
at io.netty.channel.epoll.Native.(Native.java:70)
at io.netty.channel.epoll.Epoll.(Epoll.java:39)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
2022-03-21 03:40:40.319 DEBUG 10 --- [ main] i.n.util.internal.NativeLibraryLoader : netty_transport_native_epoll cannot be loaded from java.library.path, now trying export to -Dio.netty.native.workdir: /tmp
java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:293)
at io.netty.channel.epoll.Native.(Native.java:70)
at io.netty.channel.epoll.Epoll.(Epoll.java:39)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
2022-03-21 03:40:40.325 WARN 10 --- [ main] com.datastax.driver.core.NettyUtil : Found Netty's native epoll transport in the classpath, but epoll is not available. Using NIO instead.
java.lang.UnsatisfiedLinkError: unsupported JNI version 0xFFFFFFFF required by /tmp/libnetty_transport_native_epoll_x86_646999333421220599529.so
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:36)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:203)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:290)
at io.netty.channel.epoll.Native.(Native.java:70)
at io.netty.channel.epoll.Epoll.(Epoll.java:39)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at com.datastax.driver.core.NettyUtil.(NettyUtil.java:57)
at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95)
at com.datastax.driver.core.Connection$Factory.(Connection.java:926)
at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499)
at com.datastax.driver.core.Cluster.init(Cluster.java:208)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376)
at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355)
at com.datastax.driver.core.Cluster.connect(Cluster.java:305)
at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272)
at org.janusgraph.diskstorage.cql.CQLStoreManager.(CQLStoreManager.java:165)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58)
at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477)
at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409)
at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration.(GraphDatabaseConfiguration.java:1382)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133)
at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113)
at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:73)
at org.onap.aai.dbmap.AAIGraph.(AAIGraph.java:54)
at org.onap.aai.dbmap.AAIGraph$Helper.(AAIGraph.java:80)
at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94)
at org.onap.aai.TraversalApp.init(TraversalApp.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:363)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:307)
at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:136)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyBeanPostProcessorsBeforeInitialization(AbstractAutowireCapableBeanFactory.java:414)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1763)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:593)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:515)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:320)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:318)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:199)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:847)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:877)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549)
at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:141)
at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:744)
at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:391)
at org.springframework.boot.SpringApplication.run(SpringApplication.java:312)
at org.onap.aai.TraversalApp.main(TraversalApp.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
at org.springframework.boot.loader.Launcher.launch(Launcher.java:51)
at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:578)
Suppressed: java.lang.UnsatisfiedLinkError: unsupported JNI version 0xFFFFFFFF required by /tmp/libnetty_transport_native_epoll_x86_646999333421220599529.so
at java.lang.ClassLoader$NativeLibrary.load(Native Method)
at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
at java.lang.Runtime.load0(Runtime.java:809)
at java.lang.System.load(System.java:1086)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:36)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
... 63 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: could not load a native library: netty_transport_native_epoll
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:224)
at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:293)
... 62 common frames omitted
Caused by: java.io.FileNotFoundException: META-INF/native/libnetty_transport_native_epoll.so
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:173)
... 63 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:349)
at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:136)
... 63 common frames omitted
Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll in java.library.path
at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
at java.lang.Runtime.loadLibrary0(Runtime.java:870)
at java.lang.System.loadLibrary(System.java:1122)
at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:369)
at java.security.AccessController.doPrivileged(Native Method)
at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:361)
at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:339)
... 64 common frames omitted
2022-03-21 03:40:40.339 DEBUG 10 --- [ main] i.n.channel.MultithreadEventLoopGroup : -Dio.netty.eventLoopThreads: 4
2022-03-21 03:40:40.362 DEBUG 10 --- [ main] io.netty.channel.nio.NioEventLoop : -Dio.netty.noKeySetOptimization: false
2022-03-21 03:40:40.363 DEBUG 10 --- [ main] io.netty.channel.nio.NioEventLoop : -Dio.netty.selectorAutoRebuildThreshold: 512
2022-03-21 03:40:40.392 DEBUG 10 --- [ main] i.netty.util.internal.PlatformDependent : org.jctools-core.MpscChunkedArrayQueue: available
2022-03-21 03:40:40.427 DEBUG 10 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.level: simple
2022-03-21 03:40:40.427 DEBUG 10 --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.targetRecords: 4
2022-03-21 03:40:40.432 DEBUG 10 --- [ main] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@790bd0e
2022-03-21 03:40:40.446 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.EXTENDED_PEER_CHECK is undefined, using default value true
2022-03-21 03:40:40.536 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:40:40.542 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.DISABLE_COALESCING is undefined, using default value false
2022-03-21 03:40:40.543 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_SCHEDULE_PERIOD_NS is undefined, using default value 10000
2022-03-21 03:40:40.543 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_RUN_WITHOUT_WORK_TIMES is undefined, using default value 5
2022-03-21 03:40:40.640 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numHeapArenas: 4
2022-03-21 03:40:40.640 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numDirectArenas: 4
2022-03-21 03:40:40.640 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.pageSize: 8192
2022-03-21 03:40:40.640 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxOrder: 11
2022-03-21 03:40:40.640 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.chunkSize: 16777216
2022-03-21 03:40:40.640 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.tinyCacheSize: 512
2022-03-21 03:40:40.640 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.smallCacheSize: 256
2022-03-21 03:40:40.640 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.normalCacheSize: 64
2022-03-21 03:40:40.640 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxCachedBufferCapacity: 32768
2022-03-21 03:40:40.640 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.cacheTrimInterval: 8192
2022-03-21 03:40:40.640 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.cacheTrimIntervalMillis: 0
2022-03-21 03:40:40.641 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.useCacheForAllThreads: true
2022-03-21 03:40:40.641 DEBUG 10 --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxCachedByteBuffersPerChunk: 1023
2022-03-21 03:40:40.687 DEBUG 10 --- [ main] io.netty.channel.DefaultChannelId : -Dio.netty.processId: 10 (auto-detected)
2022-03-21 03:40:40.691 DEBUG 10 --- [ main] io.netty.util.NetUtil : -Djava.net.preferIPv4Stack: false
2022-03-21 03:40:40.691 DEBUG 10 --- [ main] io.netty.util.NetUtil : -Djava.net.preferIPv6Addresses: false
2022-03-21 03:40:40.695 DEBUG 10 --- [ main] io.netty.util.NetUtil : Loopback interface: lo (lo, 127.0.0.1)
2022-03-21 03:40:40.696 DEBUG 10 --- [ main] io.netty.util.NetUtil : /proc/sys/net/core/somaxconn: 4096
2022-03-21 03:40:40.698 DEBUG 10 --- [ main] io.netty.channel.DefaultChannelId : -Dio.netty.machineId: ea:9d:05:ff:fe:d6:b8:61 (auto-detected)
2022-03-21 03:40:40.776 DEBUG 10 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.allocator.type: pooled
2022-03-21 03:40:40.777 DEBUG 10 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.threadLocalDirectBufferSize: 0
2022-03-21 03:40:40.777 DEBUG 10 --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.maxThreadLocalCharBufferSize: 16384
2022-03-21 03:40:40.902 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:40:40.981 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxCapacityPerThread: 4096
2022-03-21 03:40:40.981 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxSharedCapacityFactor: 2
2022-03-21 03:40:40.981 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.linkCapacity: 16
2022-03-21 03:40:40.981 DEBUG 10 --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.ratio: 8
2022-03-21 03:40:40.999 DEBUG 10 --- [er-nio-worker-0] io.netty.buffer.AbstractByteBuf : -Dio.netty.buffer.checkAccessible: true
2022-03-21 03:40:40.999 DEBUG 10 --- [er-nio-worker-0] io.netty.buffer.AbstractByteBuf : -Dio.netty.buffer.checkBounds: true
2022-03-21 03:40:40.999 DEBUG 10 --- [er-nio-worker-0] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@22039439
2022-03-21 03:40:45.332 DEBUG 10 --- [er-nio-worker-0] c.datastax.driver.core.SystemProperties : com.datastax.driver.NATIVE_TRANSPORT_MAX_FRAME_SIZE_IN_MB is undefined, using default value 256
2022-03-21 03:40:52.089 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:40:52.093 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2022-03-21 03:40:55.025 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema
2022-03-21 03:40:56.748 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdcartifact.
2022-03-21 03:40:56.785 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdcartifact completed in 37 milliseconds
2022-03-21 03:40:56.803 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.233.70.52:9042
2022-03-21 03:40:56.804 INFO 10 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor)
2022-03-21 03:40:56.807 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.233.69.27:9042 added
2022-03-21 03:40:56.807 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.233.70.52:9042 added
2022-03-21 03:40:56.807 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.233.71.20:9042 added
2022-03-21 03:40:56.813 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.CHECK_IO_DEADLOCKS is undefined, using default value true
2022-03-21 03:40:56.822 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:40:56.827 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:40:56.838 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 2
2022-03-21 03:40:56.839 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:40:56.841 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:40:56.851 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:40:57.875 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:40:57.879 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.69.27:9042 (1 connections needed, 1 successfully opened)
2022-03-21 03:40:57.879 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for /10.233.69.27:9042
2022-03-21 03:41:01.988 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:41:01.989 DEBUG 10 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.233.70.52:9042 (1 connections needed, 1 successfully opened)
2022-03-21 03:41:01.989 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Session : Added connection pool for cassandra/10.233.70.52:9042
2022-03-21 03:41:07.678 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:41:07.679 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.71.20:9042 (1 connections needed, 1 successfully opened)
2022-03-21 03:41:07.679 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for /10.233.71.20:9042
2022-03-21 03:41:09.763 DEBUG 10 --- [ main] org.reflections.Reflections : going to scan these urls:
file:/opt/app/aai-traversal/resources/
2022-03-21 03:41:09.783 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/query/stored-queries.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.784 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/query/stored-queries.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.784 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.785 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.785 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.786 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.786 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v24/aai_oxm_v24.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.787 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v24/aai_oxm_v24.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.788 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.788 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.789 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.790 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.790 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.791 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.792 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.792 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.793 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.793 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.794 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.795 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.795 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.796 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.797 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.797 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.798 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.799 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.799 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.800 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.800 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.801 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.801 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.802 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.802 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.803 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.804 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.804 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.805 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.806 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.806 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.807 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.807 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.808 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.808 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_pnp_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.808 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_pnp_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.809 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_hpa_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.809 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_hpa_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.810 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_esr_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.810 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_esr_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.811 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_ccvpn_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.811 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_ccvpn_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.812 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_bbs_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.812 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v24/DbEdgeRules_bbs_v24.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.812 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.813 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.813 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.814 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.814 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.814 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.815 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.815 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.816 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.816 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.817 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.817 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.818 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.819 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.819 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.820 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.821 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.821 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.822 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.823 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.823 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.823 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.824 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.824 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.825 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.825 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.826 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.826 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.827 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.827 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.828 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.828 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.829 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.829 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.830 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.831 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.832 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.832 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.833 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.833 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.834 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.834 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.835 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.835 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.836 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.836 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.837 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.837 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.838 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.838 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.839 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.839 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.840 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.840 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.840 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.841 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.841 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.842 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.843 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.843 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.844 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.844 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.845 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.845 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.845 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.846 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.846 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.847 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.847 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.848 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.848 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.849 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.849 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.850 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.851 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.852 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.853 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.853 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.853 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.854 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.854 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.855 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.855 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.856 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.856 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.857 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.857 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.857 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.858 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.858 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.859 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.859 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.859 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.860 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.860 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.861 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.861 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.862 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.862 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.863 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.863 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.863 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.864 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.864 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.865 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.865 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.866 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.866 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.867 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.867 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.867 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.868 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.868 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.869 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.869 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.870 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.870 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.871 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.871 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.872 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.872 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.873 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.873 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.874 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.874 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.875 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.875 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.876 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.877 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.877 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.878 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.878 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.879 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.879 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.880 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.880 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.881 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.881 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.882 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.882 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.883 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.884 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.884 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.885 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.885 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpn-binding-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.885 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpn-binding-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.886 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpls-pe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.886 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpls-pe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.887 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.887 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vpe-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.888 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.888 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.889 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.889 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/volume-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.889 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnfc-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.890 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnfc-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.890 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnf-image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.891 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vnf-image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.891 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vlan-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.892 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vlan-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.892 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/virtual-data-center-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.892 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/virtual-data-center-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.893 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vig-server-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.893 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vig-server-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.894 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vf-module-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.894 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vf-module-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.895 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.895 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/vce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.896 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/update-node-key-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.896 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/update-node-key-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.896 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tunnel-xconnect-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.897 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tunnel-xconnect-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.897 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tenant-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.898 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tenant-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.899 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tagged-inventory-item-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.899 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/tagged-inventory-item-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.900 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/subnet-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.900 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/subnet-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.901 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/start-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.901 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/start-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.902 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/sriov-vf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.902 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/sriov-vf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.902 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/snapshot-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.903 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/snapshot-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.903 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.904 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.904 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.905 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/site-pair-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.906 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-subscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.906 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-subscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.907 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.907 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.907 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-capability-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.908 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-capability-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.908 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.909 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.909 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/segmentation-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.910 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/segmentation-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.911 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/secondary-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.911 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/secondary-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.912 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/routing-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.912 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/routing-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.913 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/route-table-reference-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.914 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/route-table-reference-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.915 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/result-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.915 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/result-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.916 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/reserved-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.917 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/reserved-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.917 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/related-lookup-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.918 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/related-lookup-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.918 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.919 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.919 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/property-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.920 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/property-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.923 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/port-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.923 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/port-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.924 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.924 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/pnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.925 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/physical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.925 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/physical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.925 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/p-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.926 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/p-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.926 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/oam-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.927 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/oam-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.927 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/newvce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.928 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/newvce-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.928 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-profile-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.928 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-profile-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.929 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-policy-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.929 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/network-policy-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.930 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.930 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.931 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.931 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.932 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/multicast-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.932 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/multicast-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.932 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-ver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.933 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-ver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.933 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.933 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-element-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.934 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.934 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-constraint-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.934 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.935 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/model-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.935 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/metadatum-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.935 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/metadatum-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.936 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/logical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.936 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/logical-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.936 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-key-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.937 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-key-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.937 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.937 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/license-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.938 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.938 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-link-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.938 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.939 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/lag-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.939 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.939 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-network-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.940 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv6-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.940 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv6-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.940 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv4-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.940 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l3-interface-ipv4-address-list-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.941 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.941 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/l-interface-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.942 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/key-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.942 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/key-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.942 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ipsec-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.943 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ipsec-configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.943 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.943 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.944 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.944 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/inventory-item-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.945 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/instance-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.945 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/instance-group-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.946 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/include-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.946 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/include-node-filter-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.947 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.947 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/image-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.947 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/group-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.948 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/group-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.948 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/generic-vnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.948 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/generic-vnf-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.949 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/flavor-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.949 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/flavor-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.949 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.950 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.951 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/entitlement-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.951 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/entitlement-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.952 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/element-choice-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.952 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/element-choice-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.953 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/edge-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.953 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/edge-prop-names-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.954 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/dvs-switch-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.954 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/dvs-switch-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.954 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cvlan-tag-entry-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.955 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cvlan-tag-entry-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.955 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/customer-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.955 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/customer-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.956 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-pool-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.956 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-pool-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.956 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.957 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/ctag-assignment-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.957 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/constrained-element-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.957 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/constrained-element-set-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.958 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/connector-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.958 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/connector-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.959 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.959 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/configuration-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.959 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/complex-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.960 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/complex-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.960 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/collection-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.961 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/collection-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.961 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cloud-region-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.961 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/cloud-region-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.962 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/class-of-service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.962 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/class-of-service-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.963 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/az-and-dvs-switches-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.963 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/az-and-dvs-switches-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.964 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/availability-zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.964 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/availability-zone-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.965 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/allotted-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.965 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/allotted-resource-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.966 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.966 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-data-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.966 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.967 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/widget-model-json/action-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.967 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/service-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.968 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/service-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.968 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/resource-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.969 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/resource-model-json/000-README in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.969 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.970 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-service-instance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.972 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.972 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/vnf-to-esr-system-info-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.973 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getWlBundleId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.973 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getWlBundleId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.974 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.974 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVserver-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.975 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVnfVlanByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.975 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getVnfVlanByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.976 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcSubscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.976 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcSubscription-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.976 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcInstance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.977 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getTenantInfoAtSvcInstance-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.977 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getSvcSubscriberModelInfo-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.977 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getSvcSubscriberModelInfo-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.978 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.978 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.979 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceModel-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.979 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getServiceInstanceModel-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.979 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getRouterRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.980 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getRouterRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.980 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getPinterfacePhysicalLinkBySvcInstId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.980 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getPinterfacePhysicalLinkBySvcInstId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.981 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getLogicalLinkByCloudRegionId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.981 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getLogicalLinkByCloudRegionId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.981 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getL3networkCloudRegionByNetworkRole-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.982 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getL3networkCloudRegionByNetworkRole-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.982 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology2-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.983 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology2-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.983 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.983 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.984 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.984 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVServiceTopology-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.984 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLinkByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.985 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLinkByCircuitId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.985 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLink-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.985 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVLogicalLink-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.986 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexLocationId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.986 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexLocationId-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.986 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexHostname-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.987 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getDHVComplexHostname-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.987 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.2.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.987 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.2.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.988 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.988 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.1.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.988 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.989 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComponentList-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.989 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComplexByPnfName-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.989 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getComplexByPnfName-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.990 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getClfiRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.990 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/getClfiRoadmTailSummary-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.990 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/closed-loop-named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.991 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/named-query-json/closed-loop-named-query-1.0.json in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.991 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.992 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.992 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.992 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.993 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.993 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.993 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.994 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.994 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.994 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.995 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.995 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.995 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.996 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.996 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.996 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.997 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file cadi.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.997 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file cadi.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.997 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:09.997 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:09.998 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file application-keycloak.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.004 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file application-keycloak.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.006 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v2/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.006 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v2/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.006 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v1/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.007 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/dsl/v1/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.007 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.007 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.008 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.008 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.009 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/permissions.properties in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.009 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/permissions.properties in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.009 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.010 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.010 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.010 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.011 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.011 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.011 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.012 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.012 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.012 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/truststoreONAPall.jks in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.013 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.013 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.osaaf.location.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.013 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.014 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.props in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.014 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.014 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.p12 in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.015 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.015 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/onap/org.onap.aai.keyfile in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.016 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/bath_config.csv in url file:/opt/app/aai-traversal/resources/ with scanner SubTypesScanner
2022-03-21 03:41:10.016 DEBUG 10 --- [ main] org.reflections.Reflections : could not scan file aaf/bath_config.csv in url file:/opt/app/aai-traversal/resources/ with scanner TypeAnnotationsScanner
2022-03-21 03:41:10.018 INFO 10 --- [ main] org.reflections.Reflections : Reflections took 253 ms to scan 1 urls, producing 0 keys and 0 values
2022-03-21 03:41:12.090 DEBUG 10 --- [ main] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=true] closing connection
2022-03-21 03:41:12.091 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] Connection[/10.233.69.27:9042-1, inFlight=0, closed=true] closed, remaining = 0
2022-03-21 03:41:12.098 DEBUG 10 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=true] closing connection
2022-03-21 03:41:12.098 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=true] closed, remaining = 1
2022-03-21 03:41:12.098 DEBUG 10 --- [ main] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=true] closing connection
2022-03-21 03:41:12.098 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-1, inFlight=0, closed=true] closed, remaining = 0
2022-03-21 03:41:12.100 DEBUG 10 --- [ main] com.datastax.driver.core.Cluster : Shutting down
2022-03-21 03:41:12.104 DEBUG 10 --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=true] closing connection
2022-03-21 03:41:12.104 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=true] closed, remaining = 0
2022-03-21 03:41:14.129 DEBUG 10 --- [er-nio-worker-0] io.netty.buffer.PoolThreadCache : Freed 37 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-0
2022-03-21 03:41:14.133 DEBUG 10 --- [er-nio-worker-1] io.netty.buffer.PoolThreadCache : Freed 21 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-1
2022-03-21 03:41:14.173 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2022-03-21 03:41:14.173 INFO 10 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2022-03-21 03:41:14.174 DEBUG 10 --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.233.70.52:9042]
2022-03-21 03:41:14.182 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:41:14.190 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:41:19.693 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:41:19.694 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2022-03-21 03:41:20.123 DEBUG 10 --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema
2022-03-21 03:41:21.864 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdcartifact.
2022-03-21 03:41:21.881 DEBUG 10 --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdcartifact completed in 17 milliseconds
2022-03-21 03:41:21.899 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.233.70.52:9042
2022-03-21 03:41:21.899 INFO 10 --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor)
2022-03-21 03:41:21.900 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.233.69.27:9042 added
2022-03-21 03:41:21.900 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.233.70.52:9042 added
2022-03-21 03:41:21.900 INFO 10 --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.233.71.20:9042 added
2022-03-21 03:41:21.901 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:41:21.903 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 2
2022-03-21 03:41:21.903 DEBUG 10 --- [ main] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:41:21.907 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:41:21.908 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:41:21.910 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:41:23.083 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:41:23.084 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.69.27:9042 (1 connections needed, 1 successfully opened)
2022-03-21 03:41:23.084 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for /10.233.69.27:9042
2022-03-21 03:41:28.388 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:41:28.389 DEBUG 10 --- [er-nio-worker-1] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.71.20:9042 (1 connections needed, 1 successfully opened)
2022-03-21 03:41:28.389 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Session : Added connection pool for /10.233.71.20:9042
2022-03-21 03:41:29.883 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:41:29.884 DEBUG 10 --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.233.70.52:9042 (1 connections needed, 1 successfully opened)
2022-03-21 03:41:29.884 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Session : Added connection pool for cassandra/10.233.70.52:9042
2022-03-21 03:41:48.508 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Processing the translator
2022-03-21 03:41:48.510 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv11
2022-03-21 03:41:48.510 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.511 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v11, BODY=
2022-03-21 03:41:48.516 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.516 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.516 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.516 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.558 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.561 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.561 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.561 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv12
2022-03-21 03:41:48.562 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.562 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v12, BODY=
2022-03-21 03:41:48.568 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.568 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.568 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.568 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.585 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.587 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.588 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.588 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv13
2022-03-21 03:41:48.589 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.590 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v13, BODY=
2022-03-21 03:41:48.592 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.592 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.592 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.592 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.611 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.614 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.615 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.615 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv14
2022-03-21 03:41:48.616 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.617 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v14, BODY=
2022-03-21 03:41:48.619 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.619 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.619 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.620 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.635 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.638 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.638 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.639 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv15
2022-03-21 03:41:48.639 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.640 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v15, BODY=
2022-03-21 03:41:48.642 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.642 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.642 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.642 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.658 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.661 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.662 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.663 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv16
2022-03-21 03:41:48.663 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.664 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v16, BODY=
2022-03-21 03:41:48.665 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.666 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.666 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.666 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.681 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.685 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.686 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.686 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv17
2022-03-21 03:41:48.686 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.687 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v17, BODY=
2022-03-21 03:41:48.689 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.689 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.689 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.689 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.702 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.706 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.706 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.707 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv18
2022-03-21 03:41:48.707 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.708 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v18, BODY=
2022-03-21 03:41:48.710 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.710 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.710 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.710 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.727 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.730 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.731 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.731 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv19
2022-03-21 03:41:48.732 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.732 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v19, BODY=
2022-03-21 03:41:48.734 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.734 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.734 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.734 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.756 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.760 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.760 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.760 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv20
2022-03-21 03:41:48.761 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.761 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v20, BODY=
2022-03-21 03:41:48.763 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.763 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.763 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.763 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.778 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.782 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.783 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.783 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv21
2022-03-21 03:41:48.783 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.784 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v21, BODY=
2022-03-21 03:41:48.786 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.786 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.786 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.786 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.807 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.812 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.813 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.813 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv22
2022-03-21 03:41:48.814 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.815 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v22, BODY=
2022-03-21 03:41:48.817 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.817 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.817 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.817 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.833 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.840 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.841 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.841 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv23
2022-03-21 03:41:48.842 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.843 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v23, BODY=
2022-03-21 03:41:48.844 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.844 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.844 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.845 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.864 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.873 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.873 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:48.874 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv24
2022-03-21 03:41:48.874 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:48.875 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v24, BODY=
2022-03-21 03:41:48.877 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:48.877 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:48.877 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:48.877 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:48.896 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:48.905 DEBUG 10 --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK
2022-03-21 03:41:48.906 DEBUG 10 --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService
2022-03-21 03:41:49.075 INFO 10 --- [ main] o.o.a.rest.search.SchemaServiceCQConfig : Calling the SchemaService to retrieve stored queries
2022-03-21 03:41:49.076 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {}
2022-03-21 03:41:49.077 DEBUG 10 --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/stored-queries, BODY=
2022-03-21 03:41:49.079 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName]
2022-03-21 03:41:49.079 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName
2022-03-21 03:41:49.079 INFO 10 --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty
2022-03-21 03:41:49.079 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke
2022-03-21 03:41:49.099 INFO 10 --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn
2022-03-21 03:41:50.427 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Found javax.persistence.Persistence on classpath containing 'getPersistenceUtil'. Assuming JPA 2 environment. Trying to instantiate JPA aware TraversableResolver
2022-03-21 03:41:50.427 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Instantiated JPA aware TraversableResolver of type org.hibernate.validator.internal.engine.resolver.JPATraversableResolver.
2022-03-21 03:41:50.428 DEBUG 10 --- [ main] .h.v.m.ResourceBundleMessageInterpolator : Loaded expression factory via original TCCL
2022-03-21 03:41:50.430 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Found javax.persistence.Persistence on classpath containing 'getPersistenceUtil'. Assuming JPA 2 environment. Trying to instantiate JPA aware TraversableResolver
2022-03-21 03:41:50.430 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Instantiated JPA aware TraversableResolver of type org.hibernate.validator.internal.engine.resolver.JPATraversableResolver.
2022-03-21 03:41:50.432 DEBUG 10 --- [ main] o.h.v.internal.engine.ConfigurationImpl : Setting custom MessageInterpolator of type org.springframework.validation.beanvalidation.LocaleContextMessageInterpolator
2022-03-21 03:41:50.433 DEBUG 10 --- [ main] o.h.v.internal.engine.ConfigurationImpl : Setting custom ConstraintValidatorFactory of type org.springframework.validation.beanvalidation.SpringConstraintValidatorFactory
2022-03-21 03:41:50.434 DEBUG 10 --- [ main] o.h.v.internal.engine.ConfigurationImpl : Setting custom ParameterNameProvider of type org.springframework.validation.beanvalidation.LocalValidatorFactoryBean$1
2022-03-21 03:41:50.436 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : Trying to load META-INF/validation.xml for XML based Validator configuration.
2022-03-21 03:41:50.436 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via user class loader
2022-03-21 03:41:50.436 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via TCCL
2022-03-21 03:41:50.437 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via Hibernate Validator's class loader
2022-03-21 03:41:50.437 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : No META-INF/validation.xml found. Using annotation based configuration only.
2022-03-21 03:41:50.456 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.springframework.validation.beanvalidation.LocaleContextMessageInterpolator as ValidatorFactory-scoped message interpolator.
2022-03-21 03:41:50.456 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.resolver.JPATraversableResolver as ValidatorFactory-scoped traversable resolver.
2022-03-21 03:41:50.456 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.util.ExecutableParameterNameProvider as ValidatorFactory-scoped parameter name provider.
2022-03-21 03:41:50.456 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.DefaultClockProvider as ValidatorFactory-scoped clock provider.
2022-03-21 03:41:50.456 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.scripting.DefaultScriptEvaluatorFactory as ValidatorFactory-scoped script evaluator factory.
2022-03-21 03:41:51.185 DEBUG 10 --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true
2022-03-21 03:41:51.185 INFO 10 --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps.
2022-03-21 03:41:51.197 WARN 10 --- [ main] .b.a.g.t.GroovyTemplateAutoConfiguration : Cannot find template location: classpath:/templates/ (please add some templates, check your Groovy configuration, or set spring.groovy.template.check-template-location=false)
2022-03-21 03:41:51.900 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:41:53.284 DEBUG 10 --- [ main] i.m.s.web.servlet.WebMvcMetricsFilter : Filter 'webMetricsFilter' configured for use
2022-03-21 03:41:53.493 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:41:55.268 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Found javax.persistence.Persistence on classpath containing 'getPersistenceUtil'. Assuming JPA 2 environment. Trying to instantiate JPA aware TraversableResolver
2022-03-21 03:41:55.268 DEBUG 10 --- [ main] o.h.v.i.e.resolver.TraversableResolvers : Instantiated JPA aware TraversableResolver of type org.hibernate.validator.internal.engine.resolver.JPATraversableResolver.
2022-03-21 03:41:55.270 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : Trying to load META-INF/validation.xml for XML based Validator configuration.
2022-03-21 03:41:55.270 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via TCCL
2022-03-21 03:41:55.271 DEBUG 10 --- [ main] o.h.v.i.xml.config.ResourceLoaderHelper : Trying to load META-INF/validation.xml via Hibernate Validator's class loader
2022-03-21 03:41:55.271 DEBUG 10 --- [ main] o.h.v.i.xml.config.ValidationXmlParser : No META-INF/validation.xml found. Using annotation based configuration only.
2022-03-21 03:41:55.288 DEBUG 10 --- [ main] .h.v.m.ResourceBundleMessageInterpolator : Loaded expression factory via original TCCL
2022-03-21 03:41:55.289 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.messageinterpolation.ResourceBundleMessageInterpolator as ValidatorFactory-scoped message interpolator.
2022-03-21 03:41:55.289 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.resolver.JPATraversableResolver as ValidatorFactory-scoped traversable resolver.
2022-03-21 03:41:55.289 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.util.ExecutableParameterNameProvider as ValidatorFactory-scoped parameter name provider.
2022-03-21 03:41:55.289 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.DefaultClockProvider as ValidatorFactory-scoped clock provider.
2022-03-21 03:41:55.289 DEBUG 10 --- [ main] o.h.v.i.engine.ValidatorFactoryImpl : HV000234: Using org.hibernate.validator.internal.engine.scripting.DefaultScriptEvaluatorFactory as ValidatorFactory-scoped script evaluator factory.
2022-03-21 03:41:55.416 WARN 10 --- [ main] org.glassfish.jersey.internal.Errors : The following warnings have been detected: WARNING: The (sub)resource method getC2Qgremlin in org.onap.aai.rest.CQ2Gremlin contains empty path annotation.
WARNING: The (sub)resource method getC2Qgremlin in org.onap.aai.rest.CQ2GremlinTest contains empty path annotation.
WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.onap.aai.rest.RecentAPIConsumer.getRecentData(java.lang.String,java.lang.String,java.lang.String,javax.ws.rs.core.HttpHeaders,javax.servlet.http.HttpServletRequest,javax.ws.rs.core.UriInfo), should not consume any entity.
2022-03-21 03:41:55.427 DEBUG 10 --- [ main] org.onap.aai.config.ErrorHandler : Filter 'errorHandler' configured for use
2022-03-21 03:41:56.302 INFO 10 --- [ main] org.onap.aai.TraversalApp : Application 'aai-traversal' is running on 8446!
2022-03-21 03:41:56.303 DEBUG 10 --- [ main] org.onap.aai.TraversalApp : Traversal MicroService Started
Traversal Microservice Started
2022-03-21 03:42:23.494 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:42:23.589 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:42:23.686 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:42:24.391 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:42:44.498 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:42:45.303 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:42:53.590 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:42:53.691 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:43:23.693 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:43:23.803 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:43:26.998 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:43:27.069 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:43:53.804 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:43:53.997 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:44:09.612 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:44:09.616 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:44:23.998 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:44:24.007 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:44:54.008 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:44:54.103 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:45:24.104 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:45:24.204 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:45:40.410 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:45:40.417 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:45:54.206 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:45:54.301 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:45:57.704 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:45:57.791 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:46:18.918 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:46:19.008 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:46:24.306 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:46:24.507 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:46:54.509 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:46:55.102 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:46:55.694 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:46:55.704 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:47:06.113 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:47:06.209 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:47:25.105 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:47:25.303 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:47:53.325 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:47:53.809 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:47:55.305 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:47:55.311 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:48:25.313 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:48:25.414 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:48:34.614 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:48:34.702 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:48:55.416 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:48:55.515 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:49:16.503 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:49:16.509 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:49:21.723 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:49:22.330 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:49:25.517 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:49:25.625 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:49:42.204 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:49:42.208 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:49:55.627 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:49:55.937 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:50:13.313 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:50:13.611 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:50:25.939 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:50:27.620 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:50:51.241 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:50:51.321 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:50:57.622 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:50:58.324 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:51:27.335 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:51:28.325 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:51:30.923 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:51:30.924 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=1, closed=false] heartbeat query succeeded
2022-03-21 03:51:37.620 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:51:37.623 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:51:46.841 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.70.52:9042, scheduling delivery
2022-03-21 03:51:46.845 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.70.52:9042] received event DOWN
2022-03-21 03:51:47.025 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-03-21 03:51:47.027 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-03-21 03:51:47.029 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preventing new connections for the next 1000 ms
2022-03-21 03:51:47.029 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=false] failed, remaining = 1
2022-03-21 03:51:47.030 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-2, inFlight=0, closed=true] closing connection
2022-03-21 03:51:47.039 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-03-21 03:51:47.039 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-03-21 03:51:47.039 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:51:47.046 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-1, inFlight=0, closed=true] closing connection
2022-03-21 03:51:47.047 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] marking host DOWN
2022-03-21 03:51:47.047 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] cassandra/10.233.70.52:9042 is down/removed and it was the control host, triggering reconnect
2022-03-21 03:51:47.053 DEBUG 10 --- [luster-worker-2] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 0ms
2022-03-21 03:51:47.054 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [Control connection] starting reconnection attempt
2022-03-21 03:51:47.054 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 2
2022-03-21 03:51:47.057 DEBUG 10 --- [luster-worker-2] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-03-21 03:51:47.058 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] starting reconnection attempt
2022-03-21 03:51:47.060 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:51:47.853 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 03:51:48.057 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:51:48.061 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-3, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 03:51:48.063 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-3, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 03:51:48.063 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-3, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:51:48.063 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-3, inFlight=0, closed=true] closing connection
2022-03-21 03:51:48.063 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 03:51:48.064 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-03-21 03:51:48.064 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 2000 ms
2022-03-21 03:51:49.815 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-2, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:51:49.815 DEBUG 10 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2022-03-21 03:51:50.018 DEBUG 10 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdcartifact.
2022-03-21 03:51:50.026 DEBUG 10 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdcartifact completed in 8 milliseconds
2022-03-21 03:51:50.039 DEBUG 10 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema
2022-03-21 03:51:50.064 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:51:50.070 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-4, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 03:51:50.071 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-4, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 03:51:50.071 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-4, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:51:50.071 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-4, inFlight=0, closed=true] closing connection
2022-03-21 03:51:50.071 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 03:51:50.072 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-03-21 03:51:50.072 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 4000 ms
2022-03-21 03:51:53.262 DEBUG 10 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdcartifact.
2022-03-21 03:51:53.269 DEBUG 10 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdcartifact completed in 7 milliseconds
2022-03-21 03:51:53.280 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] established to /10.233.71.20:9042
2022-03-21 03:51:53.280 DEBUG 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2022-03-21 03:51:54.072 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:51:54.077 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-5, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 03:51:54.077 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-5, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 03:51:54.077 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-5, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:51:54.077 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-5, inFlight=0, closed=true] closing connection
2022-03-21 03:51:54.077 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 03:51:54.078 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-03-21 03:51:54.078 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 8000 ms
2022-03-21 03:52:02.079 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:52:02.083 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-6, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 03:52:02.083 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-6, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 03:52:02.084 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-6, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:52:02.084 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-6, inFlight=0, closed=true] closing connection
2022-03-21 03:52:02.084 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 03:52:02.085 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-03-21 03:52:02.085 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 16000 ms
2022-03-21 03:52:05.916 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.71.20:9042, scheduling delivery
2022-03-21 03:52:05.917 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] received event DOWN
2022-03-21 03:52:05.927 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-03-21 03:52:05.927 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] because: [/10.233.71.20:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-03-21 03:52:05.928 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preventing new connections for the next 1000 ms
2022-03-21 03:52:05.928 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-1, inFlight=0, closed=false] failed, remaining = 1
2022-03-21 03:52:05.928 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-1, inFlight=0, closed=true] closing connection
2022-03-21 03:52:06.112 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-2, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-03-21 03:52:06.112 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-2, inFlight=0, closed=false] because: [/10.233.71.20:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-03-21 03:52:06.112 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-2, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:52:06.113 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-2, inFlight=0, closed=true] closing connection
2022-03-21 03:52:06.113 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] marking host DOWN
2022-03-21 03:52:06.113 DEBUG 10 --- [luster-worker-2] c.d.driver.core.ControlConnection : [Control connection] /10.233.71.20:9042 is down/removed and it was the control host, triggering reconnect
2022-03-21 03:52:06.113 DEBUG 10 --- [luster-worker-2] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 0ms
2022-03-21 03:52:06.113 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [Control connection] starting reconnection attempt
2022-03-21 03:52:06.113 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preparing to open 1 new connections, total = 2
2022-03-21 03:52:06.113 DEBUG 10 --- [luster-worker-2] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-03-21 03:52:06.113 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] starting reconnection attempt
2022-03-21 03:52:06.118 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-2, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:52:06.278 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.69.27:9042-2, inFlight=0, closed=false] because: Authentication error on host /10.233.69.27:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:06.278 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preventing new connections for the next 1000 ms
2022-03-21 03:52:06.278 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] Connection[/10.233.69.27:9042-2, inFlight=0, closed=false] failed, remaining = 1
2022-03-21 03:52:06.278 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-2, inFlight=0, closed=true] closing connection
2022-03-21 03:52:06.280 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-2, inFlight=0, closed=true] has already terminated
2022-03-21 03:52:06.281 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.69.27:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:06.282 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 1000 ms
2022-03-21 03:52:06.917 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 03:52:07.114 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:52:07.118 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-3, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 03:52:07.118 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-3, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 03:52:07.118 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-3, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:52:07.119 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-3, inFlight=0, closed=true] closing connection
2022-03-21 03:52:07.119 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 03:52:07.119 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-03-21 03:52:07.119 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 2000 ms
2022-03-21 03:52:07.282 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preparing to open 1 new connections, total = 2
2022-03-21 03:52:07.288 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-3, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:52:07.516 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.69.27:9042-3, inFlight=0, closed=false] because: Authentication error on host /10.233.69.27:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:07.517 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preventing new connections for the next 1000 ms
2022-03-21 03:52:07.517 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] Connection[/10.233.69.27:9042-3, inFlight=0, closed=false] failed, remaining = 1
2022-03-21 03:52:07.517 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-3, inFlight=0, closed=true] closing connection
2022-03-21 03:52:07.518 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-3, inFlight=0, closed=true] has already terminated
2022-03-21 03:52:07.518 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.69.27:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:07.519 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 2000 ms
2022-03-21 03:52:07.937 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [153079895-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@162f1565 at consistency null
2022-03-21 03:52:07.937 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [153079895-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:08.030 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [853397035-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1adf9916 at consistency null
2022-03-21 03:52:08.030 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [853397035-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:08.095 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1002492769-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@362c2274 at consistency null
2022-03-21 03:52:08.095 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1002492769-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:08.201 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [351088718-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@24c5a882 at consistency null
2022-03-21 03:52:08.201 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [351088718-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:08.308 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1402509952-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4a2f1542 at consistency null
2022-03-21 03:52:08.308 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1402509952-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:08.414 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [266906190-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2c5e2238 at consistency null
2022-03-21 03:52:08.414 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [266906190-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:08.625 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [839793417-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7b369a45 at consistency null
2022-03-21 03:52:08.626 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [839793417-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:08.837 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1335628358-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@72beac19 at consistency null
2022-03-21 03:52:08.837 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1335628358-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:09.045 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1481104815-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1d9b87d2 at consistency null
2022-03-21 03:52:09.045 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1481104815-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:09.120 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:52:09.129 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-4, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 03:52:09.130 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-4, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 03:52:09.130 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-4, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:52:09.130 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-4, inFlight=0, closed=true] closing connection
2022-03-21 03:52:09.132 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-03-21 03:52:09.132 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 4000 ms
2022-03-21 03:52:09.133 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 03:52:09.253 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [305641011-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@52b0c296 at consistency null
2022-03-21 03:52:09.253 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [305641011-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:09.519 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preparing to open 1 new connections, total = 2
2022-03-21 03:52:09.521 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-4, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:52:09.528 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.69.27:9042-4, inFlight=0, closed=false] because: Authentication error on host /10.233.69.27:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:09.529 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preventing new connections for the next 1000 ms
2022-03-21 03:52:09.529 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] Connection[/10.233.69.27:9042-4, inFlight=0, closed=false] failed, remaining = 1
2022-03-21 03:52:09.529 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-4, inFlight=0, closed=true] closing connection
2022-03-21 03:52:09.529 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-4, inFlight=0, closed=true] has already terminated
2022-03-21 03:52:09.529 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.69.27:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:09.530 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 4000 ms
2022-03-21 03:52:09.659 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1369571599-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@55e972bd at consistency null
2022-03-21 03:52:09.659 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1369571599-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:10.468 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2122528607-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5cf91b63 at consistency null
2022-03-21 03:52:10.469 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2122528607-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:11.287 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [407840645-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1d1db239 at consistency null
2022-03-21 03:52:11.287 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [407840645-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:11.290 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:52:13.133 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:52:13.137 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-5, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 03:52:13.137 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-5, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 03:52:13.137 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-5, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:52:13.137 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-5, inFlight=0, closed=true] closing connection
2022-03-21 03:52:13.137 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 03:52:13.138 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-03-21 03:52:13.138 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 8000 ms
2022-03-21 03:52:13.531 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preparing to open 1 new connections, total = 2
2022-03-21 03:52:13.533 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-5, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:52:13.547 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.69.27:9042-5, inFlight=0, closed=false] because: Authentication error on host /10.233.69.27:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:13.548 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preventing new connections for the next 1000 ms
2022-03-21 03:52:13.548 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] Connection[/10.233.69.27:9042-5, inFlight=0, closed=false] failed, remaining = 1
2022-03-21 03:52:13.548 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-5, inFlight=0, closed=true] closing connection
2022-03-21 03:52:13.549 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.69.27:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:13.550 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 8000 ms
2022-03-21 03:52:13.549 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-5, inFlight=0, closed=true] has already terminated
2022-03-21 03:52:16.308 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [937860241-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@11b10a40 at consistency null
2022-03-21 03:52:16.309 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [937860241-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:16.400 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1988974875-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3a566c3a at consistency null
2022-03-21 03:52:16.400 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1988974875-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:16.497 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [290693466-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@34fe461e at consistency null
2022-03-21 03:52:16.497 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [290693466-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:16.604 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1891749882-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2d4cae95 at consistency null
2022-03-21 03:52:16.604 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1891749882-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:16.809 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1933629287-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@34b65276 at consistency null
2022-03-21 03:52:16.809 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1933629287-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:17.218 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1863912853-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3d08cf66 at consistency null
2022-03-21 03:52:17.219 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1863912853-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:18.085 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:52:18.089 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-7, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 03:52:18.089 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-7, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 03:52:18.089 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-7, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:52:18.090 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-7, inFlight=0, closed=true] closing connection
2022-03-21 03:52:18.090 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 03:52:18.090 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-03-21 03:52:18.090 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 32000 ms
2022-03-21 03:52:18.096 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1665939549-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7b00b06f at consistency null
2022-03-21 03:52:18.097 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1665939549-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:18.903 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [495748561-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@33f0919c at consistency null
2022-03-21 03:52:18.904 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [495748561-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:19.797 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1753383656-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@35d35076 at consistency null
2022-03-21 03:52:19.797 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1753383656-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:19.799 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:52:21.138 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:52:21.142 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-6, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 03:52:21.142 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-6, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 03:52:21.143 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-6, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:52:21.143 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-6, inFlight=0, closed=true] closing connection
2022-03-21 03:52:21.143 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 03:52:21.143 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-03-21 03:52:21.144 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 16000 ms
2022-03-21 03:52:21.550 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preparing to open 1 new connections, total = 2
2022-03-21 03:52:21.553 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-6, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:52:21.609 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.69.27:9042-6, inFlight=0, closed=false] because: Authentication error on host /10.233.69.27:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:21.610 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preventing new connections for the next 1000 ms
2022-03-21 03:52:21.610 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] Connection[/10.233.69.27:9042-6, inFlight=0, closed=false] failed, remaining = 1
2022-03-21 03:52:21.610 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-6, inFlight=0, closed=true] closing connection
2022-03-21 03:52:21.611 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-6, inFlight=0, closed=true] has already terminated
2022-03-21 03:52:21.611 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.69.27:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:21.611 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 16000 ms
2022-03-21 03:52:24.819 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1339056072-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4edbda55 at consistency null
2022-03-21 03:52:24.819 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1339056072-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:24.897 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1306265791-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@30a69829 at consistency null
2022-03-21 03:52:24.897 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1306265791-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:24.999 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [881311448-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@76d83d0 at consistency null
2022-03-21 03:52:25.000 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [881311448-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:25.201 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1215229794-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@289233ab at consistency null
2022-03-21 03:52:25.201 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1215229794-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:25.501 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [93181880-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@380b5d9e at consistency null
2022-03-21 03:52:25.501 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [93181880-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:26.003 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [674868806-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3ce8ed66 at consistency null
2022-03-21 03:52:26.003 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [674868806-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:26.898 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [557954279-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@57f08a28 at consistency null
2022-03-21 03:52:26.898 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [557954279-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:27.710 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [510347858-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6ec6f416 at consistency null
2022-03-21 03:52:27.710 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [510347858-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:28.514 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1974500912-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@c43a3fd at consistency null
2022-03-21 03:52:28.515 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1974500912-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:28.516 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:52:33.524 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [278832478-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@773becce at consistency null
2022-03-21 03:52:33.524 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [278832478-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:33.583 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1020579110-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@24c989cb at consistency null
2022-03-21 03:52:33.583 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1020579110-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:33.689 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2015967540-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7d76af00 at consistency null
2022-03-21 03:52:33.690 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2015967540-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:33.803 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [245271039-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6cbba718 at consistency null
2022-03-21 03:52:33.803 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [245271039-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:34.010 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1808759079-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@444e6bdd at consistency null
2022-03-21 03:52:34.010 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1808759079-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:34.418 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1902654597-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2ca1254e at consistency null
2022-03-21 03:52:34.418 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1902654597-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:34.824 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1085883141-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@55d56996 at consistency null
2022-03-21 03:52:34.824 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1085883141-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:35.632 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [974318492-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6272f072 at consistency null
2022-03-21 03:52:35.632 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [974318492-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:36.438 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [704949176-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@475c3227 at consistency null
2022-03-21 03:52:36.438 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [704949176-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:36.440 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:52:37.144 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:52:37.148 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-7, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 03:52:37.148 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-7, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 03:52:37.148 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-7, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:52:37.148 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-7, inFlight=0, closed=true] closing connection
2022-03-21 03:52:37.149 DEBUG 10 --- [luster-worker-3] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 03:52:37.149 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-03-21 03:52:37.149 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 32000 ms
2022-03-21 03:52:37.612 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preparing to open 1 new connections, total = 2
2022-03-21 03:52:37.614 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-7, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:52:37.619 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.69.27:9042-7, inFlight=0, closed=false] because: Authentication error on host /10.233.69.27:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:37.619 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preventing new connections for the next 1000 ms
2022-03-21 03:52:37.620 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] Connection[/10.233.69.27:9042-7, inFlight=0, closed=false] failed, remaining = 1
2022-03-21 03:52:37.620 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-7, inFlight=0, closed=true] closing connection
2022-03-21 03:52:37.621 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-7, inFlight=0, closed=true] has already terminated
2022-03-21 03:52:37.621 ERROR 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.69.27:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:52:37.621 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 32000 ms
2022-03-21 03:52:41.448 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [452492897-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@140ba111 at consistency null
2022-03-21 03:52:41.448 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [452492897-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:41.485 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [282310480-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@326064bd at consistency null
2022-03-21 03:52:41.486 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [282310480-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:41.517 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1026613469-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6e28891e at consistency null
2022-03-21 03:52:41.517 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1026613469-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:41.573 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [845600168-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@765e4645 at consistency null
2022-03-21 03:52:41.573 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [845600168-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:41.681 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1807003379-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f1462b6 at consistency null
2022-03-21 03:52:41.681 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1807003379-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:41.887 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1724968418-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ee0ac65 at consistency null
2022-03-21 03:52:41.887 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1724968418-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:42.291 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1549586413-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@24aaa4de at consistency null
2022-03-21 03:52:42.291 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1549586413-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:42.696 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1486068315-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2042b260 at consistency null
2022-03-21 03:52:42.696 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1486068315-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:43.506 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [371090572-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3cdf650c at consistency null
2022-03-21 03:52:43.506 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [371090572-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:44.322 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2009080912-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@46aaab06 at consistency null
2022-03-21 03:52:44.322 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2009080912-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:44.324 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:52:49.403 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1297723106-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@734ed001 at consistency null
2022-03-21 03:52:49.403 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1297723106-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:49.517 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [165459024-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@34fe3c61 at consistency null
2022-03-21 03:52:49.518 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [165459024-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:49.717 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1812171747-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@380e934d at consistency null
2022-03-21 03:52:49.717 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1812171747-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:49.903 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [446156951-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2b6ffdd1 at consistency null
2022-03-21 03:52:49.903 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [446156951-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:50.091 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:52:50.094 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-8, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 03:52:50.095 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-8, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 03:52:50.095 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-8, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:52:50.095 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-8, inFlight=0, closed=true] closing connection
2022-03-21 03:52:50.095 DEBUG 10 --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 03:52:50.096 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-03-21 03:52:50.096 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 64000 ms
2022-03-21 03:52:50.197 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [448353177-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2e24fe65 at consistency null
2022-03-21 03:52:50.198 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [448353177-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:50.706 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1982532266-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6b7cd2f4 at consistency null
2022-03-21 03:52:50.707 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1982532266-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:51.605 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [109562655-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27a4b02d at consistency null
2022-03-21 03:52:51.606 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [109562655-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:52.411 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [582000688-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@73f1407d at consistency null
2022-03-21 03:52:52.411 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [582000688-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:53.299 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1925515876-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7a2f5fb0 at consistency null
2022-03-21 03:52:53.299 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1925515876-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:53.301 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:52:58.311 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1553281228-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7749d973 at consistency null
2022-03-21 03:52:58.311 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1553281228-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:58.366 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1693632370-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@756e2a6f at consistency null
2022-03-21 03:52:58.367 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1693632370-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:58.424 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1130650364-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ce57e17 at consistency null
2022-03-21 03:52:58.424 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1130650364-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:58.530 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [422112990-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@cb772e4 at consistency null
2022-03-21 03:52:58.531 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [422112990-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:58.637 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1817099879-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@350ca040 at consistency null
2022-03-21 03:52:58.637 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1817099879-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:58.844 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [511000011-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3135d9dc at consistency null
2022-03-21 03:52:58.844 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [511000011-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:52:59.252 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2141665091-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@16071c2b at consistency null
2022-03-21 03:52:59.252 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2141665091-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:00.059 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [556234871-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@21107c5d at consistency null
2022-03-21 03:53:00.060 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [556234871-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:00.865 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [939743154-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@71cec69f at consistency null
2022-03-21 03:53:00.865 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [939743154-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:00.867 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:53:05.879 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [254783004-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6e2a0a43 at consistency null
2022-03-21 03:53:05.880 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [254783004-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:05.941 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1232375189-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4062a5e9 at consistency null
2022-03-21 03:53:05.941 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1232375189-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:06.047 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1393209356-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@62b2db2c at consistency null
2022-03-21 03:53:06.047 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1393209356-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:06.261 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1905705752-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@654f03db at consistency null
2022-03-21 03:53:06.262 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1905705752-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:06.667 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [54254712-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5b097523 at consistency null
2022-03-21 03:53:06.667 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [54254712-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:07.472 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1850667439-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@e91ce46 at consistency null
2022-03-21 03:53:07.473 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1850667439-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:09.085 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1757591226-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7a8e1f03 at consistency null
2022-03-21 03:53:09.086 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1757591226-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:09.088 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:53:09.150 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:53:09.154 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-8, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 03:53:09.154 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-8, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 03:53:09.155 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-8, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:53:09.156 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-8, inFlight=0, closed=true] closing connection
2022-03-21 03:53:09.156 DEBUG 10 --- [luster-worker-4] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 03:53:09.156 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-03-21 03:53:09.156 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 64000 ms
2022-03-21 03:53:09.622 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preparing to open 1 new connections, total = 2
2022-03-21 03:53:09.625 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-8, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:53:09.630 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.69.27:9042-8, inFlight=0, closed=false] because: Authentication error on host /10.233.69.27:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:53:09.630 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preventing new connections for the next 1000 ms
2022-03-21 03:53:09.631 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] Connection[/10.233.69.27:9042-8, inFlight=0, closed=false] failed, remaining = 1
2022-03-21 03:53:09.631 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-8, inFlight=0, closed=true] closing connection
2022-03-21 03:53:09.631 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-8, inFlight=0, closed=true] has already terminated
2022-03-21 03:53:09.631 ERROR 10 --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.233.69.27:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM
2022-03-21 03:53:09.632 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 64000 ms
2022-03-21 03:53:14.107 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [797648569-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@771158a2 at consistency null
2022-03-21 03:53:14.107 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [797648569-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:14.199 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1913579308-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7d6d3744 at consistency null
2022-03-21 03:53:14.200 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1913579308-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:14.305 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1800708939-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6bc6756f at consistency null
2022-03-21 03:53:14.305 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1800708939-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:14.511 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [383692797-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@166ff4fd at consistency null
2022-03-21 03:53:14.511 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [383692797-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:14.717 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1612119409-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@22c2663 at consistency null
2022-03-21 03:53:14.717 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1612119409-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:15.004 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1696874968-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@79cc87ad at consistency null
2022-03-21 03:53:15.004 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1696874968-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:15.217 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [723843276-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2179e8f6 at consistency null
2022-03-21 03:53:15.217 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [723843276-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:15.503 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1214651154-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@48582838 at consistency null
2022-03-21 03:53:15.503 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1214651154-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:15.917 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [525109786-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2b24006e at consistency null
2022-03-21 03:53:15.918 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [525109786-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:16.799 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1478566570-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@36c81b48 at consistency null
2022-03-21 03:53:16.799 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1478566570-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:17.612 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1422873594-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@58987b3f at consistency null
2022-03-21 03:53:17.612 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1422873594-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:17.613 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:53:22.625 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [747203834-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@510881fc at consistency null
2022-03-21 03:53:22.625 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [747203834-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:22.703 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1475231531-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5a24ccc3 at consistency null
2022-03-21 03:53:22.703 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1475231531-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:22.817 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [109798158-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2c409e94 at consistency null
2022-03-21 03:53:22.817 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [109798158-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:22.910 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [687186086-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@379a49a0 at consistency null
2022-03-21 03:53:22.910 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [687186086-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:23.024 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1341974526-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@220829ce at consistency null
2022-03-21 03:53:23.024 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1341974526-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:23.208 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1766694477-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5eb6ab98 at consistency null
2022-03-21 03:53:23.208 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1766694477-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:23.314 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [872612729-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@76aa2ae4 at consistency null
2022-03-21 03:53:23.314 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [872612729-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:23.524 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [838231503-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1398aad8 at consistency null
2022-03-21 03:53:23.524 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [838231503-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:24.018 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [429766424-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@703db73c at consistency null
2022-03-21 03:53:24.018 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [429766424-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:24.429 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [480767376-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1b3c28c8 at consistency null
2022-03-21 03:53:24.429 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [480767376-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:25.308 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [814955958-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3c66dc41 at consistency null
2022-03-21 03:53:25.308 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [814955958-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:25.310 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:53:30.329 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [852098678-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6a7e6f7f at consistency null
2022-03-21 03:53:30.329 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [852098678-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:30.361 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1184414272-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@77e7b15b at consistency null
2022-03-21 03:53:30.361 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1184414272-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:30.418 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1701839982-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@d67ad07 at consistency null
2022-03-21 03:53:30.418 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1701839982-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:30.527 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1286073339-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@769ec3e at consistency null
2022-03-21 03:53:30.527 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1286073339-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:30.637 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [828413527-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1ef57e3b at consistency null
2022-03-21 03:53:30.637 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [828413527-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:30.747 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [841576577-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@54d269d7 at consistency null
2022-03-21 03:53:30.747 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [841576577-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:30.952 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1461666270-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@646de9df at consistency null
2022-03-21 03:53:30.952 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1461666270-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:31.358 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [613716213-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2c2df170 at consistency null
2022-03-21 03:53:31.358 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [613716213-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:32.163 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [301168670-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@191c5668 at consistency null
2022-03-21 03:53:32.164 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [301168670-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:33.769 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1755819993-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5ec7184d at consistency null
2022-03-21 03:53:33.769 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1755819993-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:33.771 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:53:38.778 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1167790754-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@55ef215b at consistency null
2022-03-21 03:53:38.778 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1167790754-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:38.836 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1166549468-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@160afce7 at consistency null
2022-03-21 03:53:38.836 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1166549468-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:38.943 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1328644859-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6d5e4758 at consistency null
2022-03-21 03:53:38.943 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1328644859-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:39.048 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [440219043-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@b3d2fce at consistency null
2022-03-21 03:53:39.049 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [440219043-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:39.161 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [120465988-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27f4220b at consistency null
2022-03-21 03:53:39.162 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [120465988-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:39.367 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [53247420-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@66581fd6 at consistency null
2022-03-21 03:53:39.368 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [53247420-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:39.780 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1086914936-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7923e0c2 at consistency null
2022-03-21 03:53:39.781 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1086914936-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:40.597 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [858432751-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1b02e377 at consistency null
2022-03-21 03:53:40.598 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [858432751-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:42.205 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1168164036-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1de06e66 at consistency null
2022-03-21 03:53:42.206 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1168164036-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:42.208 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:53:47.216 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [620859473-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3b6074a3 at consistency null
2022-03-21 03:53:47.216 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [620859473-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:47.304 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [759928648-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5136ff65 at consistency null
2022-03-21 03:53:47.304 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [759928648-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:47.403 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1268798418-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f3b287b at consistency null
2022-03-21 03:53:47.403 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1268798418-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:47.506 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [140851334-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@77468853 at consistency null
2022-03-21 03:53:47.506 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [140851334-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:47.602 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [567255747-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3712dc18 at consistency null
2022-03-21 03:53:47.602 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [567255747-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:47.706 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1355776101-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@51b9d048 at consistency null
2022-03-21 03:53:47.706 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1355776101-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:47.812 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [431515501-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@475742f4 at consistency null
2022-03-21 03:53:47.812 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [431515501-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:48.005 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [943250900-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4905e5d at consistency null
2022-03-21 03:53:48.006 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [943250900-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:48.114 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1690151338-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2543a0cb at consistency null
2022-03-21 03:53:48.115 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1690151338-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:48.404 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1222496752-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3a671fbb at consistency null
2022-03-21 03:53:48.404 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1222496752-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:48.702 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [302273673-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@47daaae1 at consistency null
2022-03-21 03:53:48.702 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [302273673-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:49.108 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1823276384-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@41be76f1 at consistency null
2022-03-21 03:53:49.109 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1823276384-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:50.019 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1700133286-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7943c3f5 at consistency null
2022-03-21 03:53:50.019 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1700133286-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:50.834 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1134687917-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7b5b81a1 at consistency null
2022-03-21 03:53:50.834 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1134687917-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 03:53:50.836 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T03:52:02.411Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 03:53:54.096 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:53:54.100 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-9, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 03:53:54.101 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-9, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 03:53:54.101 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-9, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:53:54.102 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-9, inFlight=0, closed=true] closing connection
2022-03-21 03:53:54.102 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 03:53:54.104 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-03-21 03:53:54.104 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 128000 ms
2022-03-21 03:54:13.157 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:54:13.161 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-9, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 03:54:13.162 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-9, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 03:54:13.162 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-9, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 03:54:13.163 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-9, inFlight=0, closed=true] closing connection
2022-03-21 03:54:13.163 DEBUG 10 --- [luster-worker-6] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 03:54:13.164 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-03-21 03:54:13.164 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 128000 ms
2022-03-21 03:54:13.632 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] preparing to open 1 new connections, total = 2
2022-03-21 03:54:13.637 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:54:14.407 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.69.27:9042] Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:54:14.408 DEBUG 10 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map
2022-03-21 03:54:14.423 DEBUG 10 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdcartifact.
2022-03-21 03:54:14.435 DEBUG 10 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdcartifact completed in 12 milliseconds
2022-03-21 03:54:14.445 DEBUG 10 --- [-reconnection-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema
2022-03-21 03:54:14.769 DEBUG 10 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdcartifact.
2022-03-21 03:54:14.784 DEBUG 10 --- [-reconnection-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdcartifact completed in 15 milliseconds
2022-03-21 03:54:14.798 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] established to /10.233.69.27:9042
2022-03-21 03:54:14.798 DEBUG 10 --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future
2022-03-21 03:54:20.309 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.71.20:9042, scheduling delivery
2022-03-21 03:54:20.310 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] received event UP
2022-03-21 03:54:21.311 DEBUG 10 --- [luster-worker-5] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.71.20:9042
2022-03-21 03:54:21.331 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] marking host UP
2022-03-21 03:54:21.332 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-03-21 03:54:21.332 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.71.20:9042
2022-03-21 03:54:21.332 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:54:21.335 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:54:30.629 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:54:32.753 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 0 new connections, total = 1
2022-03-21 03:54:32.754 DEBUG 10 --- [luster-worker-5] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.71.20:9042 (1 connections needed, 1 successfully opened)
2022-03-21 03:54:32.756 DEBUG 10 --- [luster-worker-5] com.datastax.driver.core.Session : Added connection pool for /10.233.71.20:9042
2022-03-21 03:54:51.338 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:54:51.404 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:55:21.405 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:55:21.418 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:55:24.708 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.70.52:9042, scheduling delivery
2022-03-21 03:55:24.708 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.70.52:9042] received event UP
2022-03-21 03:55:25.710 DEBUG 10 --- [luster-worker-7] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on cassandra/10.233.70.52:9042
2022-03-21 03:55:25.724 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] marking host UP
2022-03-21 03:55:25.724 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-03-21 03:55:25.724 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node cassandra/10.233.70.52:9042
2022-03-21 03:55:25.724 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 03:55:25.739 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 03:55:31.648 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 03:55:32.140 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 0 new connections, total = 1
2022-03-21 03:55:32.140 DEBUG 10 --- [luster-worker-7] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.233.70.52:9042 (1 connections needed, 1 successfully opened)
2022-03-21 03:55:32.140 DEBUG 10 --- [luster-worker-7] com.datastax.driver.core.Session : Added connection pool for cassandra/10.233.70.52:9042
2022-03-21 03:55:55.728 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:55:55.818 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:56:14.838 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:56:17.231 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:56:25.819 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:56:25.824 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:56:55.851 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:56:55.932 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:57:00.967 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:57:01.742 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:57:25.933 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:57:25.937 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:57:32.350 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:57:32.354 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:57:42.850 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:57:42.937 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:57:55.960 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:57:56.014 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:58:26.014 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:58:26.018 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:58:56.042 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:58:56.051 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:59:06.254 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:59:06.350 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:59:26.072 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:59:26.119 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:59:36.352 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:59:36.448 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:59:37.155 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:59:37.158 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 03:59:56.120 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 03:59:56.124 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:00:14.057 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:00:14.152 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:00:26.152 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:00:26.224 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:00:44.154 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:00:44.160 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:00:56.225 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:00:56.235 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:01:17.542 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:01:17.626 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:01:26.254 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:01:26.329 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:01:53.527 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:01:53.530 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:01:56.330 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:01:56.333 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:02:19.290 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:02:19.362 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:02:26.361 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:02:26.431 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:02:55.458 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:02:55.535 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:02:56.433 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:02:56.447 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:03:26.462 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:03:26.466 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:03:34.470 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:03:34.571 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:03:44.752 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:03:44.956 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:03:56.491 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:03:56.535 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:04:14.958 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:04:15.067 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:04:15.635 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:04:15.652 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:04:26.536 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:04:26.549 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:04:56.566 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:04:56.575 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:05:26.596 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:05:26.641 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:05:56.510 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:05:56.642 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:05:56.649 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:05:56.677 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:06:17.046 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:06:17.058 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:06:26.670 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:06:26.741 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:06:56.742 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:06:56.775 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:07:09.608 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:07:09.693 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:07:23.068 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.70.52:9042, scheduling delivery
2022-03-21 04:07:23.068 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.70.52:9042] received event DOWN
2022-03-21 04:07:23.188 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-03-21 04:07:23.188 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-03-21 04:07:23.189 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preventing new connections for the next 1000 ms
2022-03-21 04:07:23.189 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:07:23.190 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] marking host DOWN
2022-03-21 04:07:23.190 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-10, inFlight=0, closed=true] closing connection
2022-03-21 04:07:23.191 DEBUG 10 --- [luster-worker-8] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-03-21 04:07:23.192 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] starting reconnection attempt
2022-03-21 04:07:24.069 DEBUG 10 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:07:24.192 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:07:24.196 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-11, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:07:24.196 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-11, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:07:24.196 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-11, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:07:24.197 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-11, inFlight=0, closed=true] closing connection
2022-03-21 04:07:24.197 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:07:24.197 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-03-21 04:07:24.197 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 2000 ms
2022-03-21 04:07:26.198 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:07:26.214 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-12, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:07:26.215 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-12, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:07:26.215 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-12, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:07:26.216 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-12, inFlight=0, closed=true] closing connection
2022-03-21 04:07:26.216 DEBUG 10 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:07:26.216 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-03-21 04:07:26.217 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 4000 ms
2022-03-21 04:07:30.217 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:07:30.222 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-13, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:07:30.222 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-13, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:07:30.222 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-13, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:07:30.222 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-13, inFlight=0, closed=true] closing connection
2022-03-21 04:07:30.223 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:07:30.223 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-03-21 04:07:30.223 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 8000 ms
2022-03-21 04:07:36.073 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-03-21 04:07:36.074 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] because: [/10.233.71.20:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-03-21 04:07:36.074 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preventing new connections for the next 1000 ms
2022-03-21 04:07:36.074 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-10, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:07:36.074 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-10, inFlight=0, closed=true] closing connection
2022-03-21 04:07:36.074 DEBUG 10 --- [luster-worker-9] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] marking host DOWN
2022-03-21 04:07:36.075 DEBUG 10 --- [luster-worker-9] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-03-21 04:07:36.075 DEBUG 10 --- [luster-worker-9] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] starting reconnection attempt
2022-03-21 04:07:36.364 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.71.20:9042, scheduling delivery
2022-03-21 04:07:36.364 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] received event DOWN
2022-03-21 04:07:36.886 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1584567190-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@620af996 at consistency null
2022-03-21 04:07:36.886 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1584567190-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:36.949 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [126627829-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1023bfda at consistency null
2022-03-21 04:07:36.949 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [126627829-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:37.023 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [592270662-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@30240b51 at consistency null
2022-03-21 04:07:37.023 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [592270662-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:37.075 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:07:37.079 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [705039971-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@47f3f4cb at consistency null
2022-03-21 04:07:37.079 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [705039971-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:37.082 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-11, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 04:07:37.082 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-11, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 04:07:37.082 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-11, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:07:37.083 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-11, inFlight=0, closed=true] closing connection
2022-03-21 04:07:37.083 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 04:07:37.084 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-03-21 04:07:37.084 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 2000 ms
2022-03-21 04:07:37.142 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1621280406-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@728063ea at consistency null
2022-03-21 04:07:37.142 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1621280406-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:37.252 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [104316656-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7fd0df0f at consistency null
2022-03-21 04:07:37.252 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [104316656-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:37.365 DEBUG 10 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 04:07:37.475 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1335442453-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6f3e3d27 at consistency null
2022-03-21 04:07:37.475 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1335442453-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:37.886 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1442207379-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3733c9a7 at consistency null
2022-03-21 04:07:37.886 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1442207379-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:38.224 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:07:38.228 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-14, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:07:38.228 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-14, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:07:38.228 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-14, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:07:38.228 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-14, inFlight=0, closed=true] closing connection
2022-03-21 04:07:38.228 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:07:38.229 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-03-21 04:07:38.229 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 16000 ms
2022-03-21 04:07:38.697 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [588692685-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@21c53138 at consistency null
2022-03-21 04:07:38.697 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [588692685-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:39.084 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:07:39.106 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-12, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 04:07:39.106 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-12, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 04:07:39.107 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-12, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:07:39.107 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-12, inFlight=0, closed=true] closing connection
2022-03-21 04:07:39.107 DEBUG 10 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 04:07:39.107 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-03-21 04:07:39.108 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 4000 ms
2022-03-21 04:07:39.510 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [409814625-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@812aa56 at consistency null
2022-03-21 04:07:39.510 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [409814625-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:40.339 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [512932077-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@257ec96f at consistency null
2022-03-21 04:07:40.339 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [512932077-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:40.343 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:07:43.108 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:07:43.112 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-13, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 04:07:43.113 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-13, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 04:07:43.113 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-13, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:07:43.113 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-13, inFlight=0, closed=true] closing connection
2022-03-21 04:07:43.113 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 04:07:43.113 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-03-21 04:07:43.113 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 8000 ms
2022-03-21 04:07:45.460 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2033661794-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7d8dca97 at consistency null
2022-03-21 04:07:45.461 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2033661794-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:45.553 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1867582557-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@754968ef at consistency null
2022-03-21 04:07:45.553 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1867582557-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:45.594 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [503124376-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3bf2a5c6 at consistency null
2022-03-21 04:07:45.594 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [503124376-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:45.653 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [371427098-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@28b8195d at consistency null
2022-03-21 04:07:45.653 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [371427098-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:45.748 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1458515611-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@168802b5 at consistency null
2022-03-21 04:07:45.748 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1458515611-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:45.862 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [826012671-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5fb51802 at consistency null
2022-03-21 04:07:45.863 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [826012671-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:46.073 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1144997265-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@71475aa7 at consistency null
2022-03-21 04:07:46.074 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1144997265-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:46.158 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1311641947-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@19ddd723 at consistency null
2022-03-21 04:07:46.158 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1311641947-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:46.257 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1637508595-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f16f307 at consistency null
2022-03-21 04:07:46.257 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1637508595-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:46.350 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [256955956-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@389497ef at consistency null
2022-03-21 04:07:46.350 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [256955956-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:46.451 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [830282114-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@734d6038 at consistency null
2022-03-21 04:07:46.452 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [830282114-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:46.551 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [258433599-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@45ec5bd at consistency null
2022-03-21 04:07:46.551 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [258433599-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:46.656 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1038101469-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7ca880fa at consistency null
2022-03-21 04:07:46.657 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1038101469-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:46.765 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [872987427-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@601f4b6f at consistency null
2022-03-21 04:07:46.765 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [872987427-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:46.946 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1843397929-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@784bbbf4 at consistency null
2022-03-21 04:07:46.947 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1843397929-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:47.156 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1503847472-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@acafa6d at consistency null
2022-03-21 04:07:47.156 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1503847472-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:47.563 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1696633370-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@325d049e at consistency null
2022-03-21 04:07:47.563 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1696633370-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:48.051 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [343993406-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@28037589 at consistency null
2022-03-21 04:07:48.052 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [343993406-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:49.064 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2032429770-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@d32ff66 at consistency null
2022-03-21 04:07:49.064 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2032429770-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:49.065 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:07:51.114 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:07:51.117 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-14, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 04:07:51.118 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-14, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 04:07:51.118 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-14, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:07:51.118 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-14, inFlight=0, closed=true] closing connection
2022-03-21 04:07:51.118 DEBUG 10 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 04:07:51.119 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-03-21 04:07:51.119 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 16000 ms
2022-03-21 04:07:54.072 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [938050234-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5076653f at consistency null
2022-03-21 04:07:54.072 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [938050234-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:54.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1446540831-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ad5f25b at consistency null
2022-03-21 04:07:54.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1446540831-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:54.181 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1170899450-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@394961b5 at consistency null
2022-03-21 04:07:54.181 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1170899450-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:54.230 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:07:54.234 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-15, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:07:54.235 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-15, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:07:54.235 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-15, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:07:54.235 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-15, inFlight=0, closed=true] closing connection
2022-03-21 04:07:54.235 DEBUG 10 --- [luster-worker-8] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:07:54.236 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-03-21 04:07:54.236 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 32000 ms
2022-03-21 04:07:54.244 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [534954419-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6544c381 at consistency null
2022-03-21 04:07:54.245 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [534954419-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:54.351 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1684368551-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@17725255 at consistency null
2022-03-21 04:07:54.351 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1684368551-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:54.464 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1903716026-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@67191346 at consistency null
2022-03-21 04:07:54.464 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1903716026-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:54.651 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1621945406-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@12fd08c7 at consistency null
2022-03-21 04:07:54.652 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1621945406-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:54.770 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1766475457-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@516699d2 at consistency null
2022-03-21 04:07:54.771 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1766475457-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:55.046 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [637865755-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@54839951 at consistency null
2022-03-21 04:07:55.047 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [637865755-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:55.264 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [343597271-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7baf23a4 at consistency null
2022-03-21 04:07:55.264 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [343597271-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:55.767 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [321921914-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1eea726 at consistency null
2022-03-21 04:07:55.767 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [321921914-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:56.247 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [687281043-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@64a316c0 at consistency null
2022-03-21 04:07:56.247 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [687281043-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:57.057 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [637840449-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2c224214 at consistency null
2022-03-21 04:07:57.057 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [637840449-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:57.862 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1698401294-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2e92e637 at consistency null
2022-03-21 04:07:57.862 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1698401294-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:07:57.864 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:08:02.871 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2005030944-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5ab1b354 at consistency null
2022-03-21 04:08:02.872 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2005030944-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:02.926 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1744414408-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@26d8bbd4 at consistency null
2022-03-21 04:08:02.927 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1744414408-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:03.031 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1687976146-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@18546ff9 at consistency null
2022-03-21 04:08:03.031 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1687976146-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:03.137 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1568588723-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@21ce819a at consistency null
2022-03-21 04:08:03.137 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1568588723-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:03.242 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [953733988-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7632ade4 at consistency null
2022-03-21 04:08:03.243 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [953733988-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:03.347 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [306048337-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@15d7beed at consistency null
2022-03-21 04:08:03.348 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [306048337-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:03.452 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [358632748-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2ec72009 at consistency null
2022-03-21 04:08:03.453 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [358632748-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:03.558 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1051223912-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7bd0a61a at consistency null
2022-03-21 04:08:03.558 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1051223912-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:03.665 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1083559978-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@186e7909 at consistency null
2022-03-21 04:08:03.666 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1083559978-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:03.874 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1035987468-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@30669c3f at consistency null
2022-03-21 04:08:03.874 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1035987468-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:04.080 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [706857402-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27362552 at consistency null
2022-03-21 04:08:04.080 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [706857402-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:04.289 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1473210545-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5928b7d8 at consistency null
2022-03-21 04:08:04.290 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1473210545-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:04.500 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [959833826-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@32653bc5 at consistency null
2022-03-21 04:08:04.501 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [959833826-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:04.712 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2065204290-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3666ded2 at consistency null
2022-03-21 04:08:04.712 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2065204290-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:04.918 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1607528066-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@20ec61f9 at consistency null
2022-03-21 04:08:04.918 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1607528066-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:05.328 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1945538345-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3ce6844b at consistency null
2022-03-21 04:08:05.328 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1945538345-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:05.741 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1700947267-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27463b01 at consistency null
2022-03-21 04:08:05.742 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1700947267-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:06.378 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:08:06.383 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:08:06.554 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1516750649-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2756f175 at consistency null
2022-03-21 04:08:06.555 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1516750649-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:06.557 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:08:07.119 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:08:07.123 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-15, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 04:08:07.124 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-15, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 04:08:07.124 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-15, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:08:07.124 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-15, inFlight=0, closed=true] closing connection
2022-03-21 04:08:07.124 DEBUG 10 --- [luster-worker-9] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 04:08:07.125 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-03-21 04:08:07.125 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 32000 ms
2022-03-21 04:08:11.587 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [35362313-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@64f6bfcf at consistency null
2022-03-21 04:08:11.588 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [35362313-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:11.646 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1171508900-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7ab21b63 at consistency null
2022-03-21 04:08:11.646 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1171508900-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:11.703 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [871228192-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6aff9019 at consistency null
2022-03-21 04:08:11.703 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [871228192-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:11.813 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1473750123-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3b26424e at consistency null
2022-03-21 04:08:11.813 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1473750123-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:12.021 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [153275206-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2fb3a77 at consistency null
2022-03-21 04:08:12.022 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [153275206-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:12.433 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1390383656-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@68785048 at consistency null
2022-03-21 04:08:12.433 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1390383656-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:13.238 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [251109296-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7e116a06 at consistency null
2022-03-21 04:08:13.239 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [251109296-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:14.049 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1684641529-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@772c73b8 at consistency null
2022-03-21 04:08:14.049 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1684641529-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:14.051 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:08:19.062 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2072910281-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2cdfc7a8 at consistency null
2022-03-21 04:08:19.062 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2072910281-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:19.158 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1441700418-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@60f286b at consistency null
2022-03-21 04:08:19.158 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1441700418-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:19.347 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1733727568-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@733b33f6 at consistency null
2022-03-21 04:08:19.348 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1733727568-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:19.579 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1335892253-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@671e3f9a at consistency null
2022-03-21 04:08:19.580 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1335892253-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:19.790 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1147863409-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@352e4656 at consistency null
2022-03-21 04:08:19.790 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1147863409-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:20.262 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1710665524-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4a1d7ce8 at consistency null
2022-03-21 04:08:20.263 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1710665524-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:20.749 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [920210127-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@601352de at consistency null
2022-03-21 04:08:20.750 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [920210127-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:21.165 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2046739960-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@76e743a9 at consistency null
2022-03-21 04:08:21.165 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2046739960-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:21.646 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1694643007-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@31bcb7d5 at consistency null
2022-03-21 04:08:21.646 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1694643007-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:22.052 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [895336356-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@10e76736 at consistency null
2022-03-21 04:08:22.052 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [895336356-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:22.546 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1236145394-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6a184256 at consistency null
2022-03-21 04:08:22.546 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1236145394-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:22.954 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1181800762-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@262ebeb7 at consistency null
2022-03-21 04:08:22.954 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1181800762-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:22.956 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:08:26.237 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:08:26.245 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-16, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:08:26.246 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-16, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:08:26.246 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-16, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:08:26.247 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-16, inFlight=0, closed=true] closing connection
2022-03-21 04:08:26.248 DEBUG 10 --- [uster-worker-10] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:08:26.248 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-03-21 04:08:26.248 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 64000 ms
2022-03-21 04:08:27.963 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [849318144-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7278b7b8 at consistency null
2022-03-21 04:08:27.963 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [849318144-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:28.047 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1785182312-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@598da016 at consistency null
2022-03-21 04:08:28.047 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1785182312-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:28.147 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1406609490-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@712f4383 at consistency null
2022-03-21 04:08:28.148 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1406609490-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:28.246 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [321819163-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@22279017 at consistency null
2022-03-21 04:08:28.247 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [321819163-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:28.347 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1568085743-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@15d5369c at consistency null
2022-03-21 04:08:28.347 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1568085743-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:28.447 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [168051153-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@21ecb920 at consistency null
2022-03-21 04:08:28.447 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [168051153-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:28.548 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1618705787-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2ad4d5c5 at consistency null
2022-03-21 04:08:28.548 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1618705787-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:28.656 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [128091429-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@34ed5fa0 at consistency null
2022-03-21 04:08:28.657 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [128091429-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:28.761 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1653025616-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@8b0fe77 at consistency null
2022-03-21 04:08:28.761 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1653025616-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:28.868 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1244001304-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4cd173f8 at consistency null
2022-03-21 04:08:28.868 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1244001304-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:29.047 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1896794242-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4027ed5a at consistency null
2022-03-21 04:08:29.048 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1896794242-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:29.156 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1654059051-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1ee9aaa1 at consistency null
2022-03-21 04:08:29.156 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1654059051-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:29.267 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [965778050-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@11a5bc4d at consistency null
2022-03-21 04:08:29.267 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [965778050-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:29.473 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1550855324-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@56ac5332 at consistency null
2022-03-21 04:08:29.474 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1550855324-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:29.881 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1539159368-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@299e3980 at consistency null
2022-03-21 04:08:29.882 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1539159368-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:30.287 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [251597244-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@460aae77 at consistency null
2022-03-21 04:08:30.288 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [251597244-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:31.100 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [856084075-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@728b4047 at consistency null
2022-03-21 04:08:31.100 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [856084075-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:31.103 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:08:36.117 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1859063899-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2a8125af at consistency null
2022-03-21 04:08:36.117 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1859063899-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:36.149 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1492053823-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4afc82be at consistency null
2022-03-21 04:08:36.150 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1492053823-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:36.213 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [787117935-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@625d7ade at consistency null
2022-03-21 04:08:36.214 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [787117935-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:36.326 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [731545935-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@41d28767 at consistency null
2022-03-21 04:08:36.326 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [731545935-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:36.406 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:08:36.415 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:08:36.531 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1027674543-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2f1d30be at consistency null
2022-03-21 04:08:36.531 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1027674543-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:36.741 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [309958191-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@15aae91 at consistency null
2022-03-21 04:08:36.741 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [309958191-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:36.947 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1876285952-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@858bfee at consistency null
2022-03-21 04:08:36.948 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1876285952-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:37.358 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [272285260-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5d64e83d at consistency null
2022-03-21 04:08:37.358 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [272285260-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:37.763 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [633543053-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1b3aabef at consistency null
2022-03-21 04:08:37.764 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [633543053-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:38.569 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2069183476-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f40a03f at consistency null
2022-03-21 04:08:38.569 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2069183476-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:38.571 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:08:39.125 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:08:39.129 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-16, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 04:08:39.130 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-16, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 04:08:39.130 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-16, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:08:39.131 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-16, inFlight=0, closed=true] closing connection
2022-03-21 04:08:39.131 DEBUG 10 --- [uster-worker-11] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 04:08:39.131 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-03-21 04:08:39.131 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 64000 ms
2022-03-21 04:08:43.586 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [982641476-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@22ac1f6 at consistency null
2022-03-21 04:08:43.587 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [982641476-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:43.623 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2140990084-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@78f5f48e at consistency null
2022-03-21 04:08:43.624 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2140990084-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:43.679 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1118739339-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@365e4dac at consistency null
2022-03-21 04:08:43.679 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1118739339-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:43.740 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [284590769-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7c554200 at consistency null
2022-03-21 04:08:43.740 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [284590769-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:43.855 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [621318176-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@28a4090d at consistency null
2022-03-21 04:08:43.856 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [621318176-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:43.964 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1029211855-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7f22d913 at consistency null
2022-03-21 04:08:43.965 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1029211855-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:44.072 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [186396716-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3b55d876 at consistency null
2022-03-21 04:08:44.073 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [186396716-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:44.179 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [802937076-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6d46c85e at consistency null
2022-03-21 04:08:44.179 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [802937076-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:44.357 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1320404159-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@65a2589a at consistency null
2022-03-21 04:08:44.357 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1320404159-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:44.469 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [925125976-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ca1ef7c at consistency null
2022-03-21 04:08:44.469 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [925125976-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:44.577 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1565755072-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@192210f6 at consistency null
2022-03-21 04:08:44.577 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1565755072-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:44.788 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [750713318-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@42fd2fb4 at consistency null
2022-03-21 04:08:44.788 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [750713318-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:45.048 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2088261362-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@356cd9f9 at consistency null
2022-03-21 04:08:45.048 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2088261362-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:45.256 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1763941032-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@36b50a27 at consistency null
2022-03-21 04:08:45.256 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1763941032-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:45.667 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [671577290-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f1909a7 at consistency null
2022-03-21 04:08:45.667 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [671577290-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:46.150 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1940769253-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@14b2017f at consistency null
2022-03-21 04:08:46.151 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1940769253-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:46.561 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1306320548-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4742b101 at consistency null
2022-03-21 04:08:46.561 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1306320548-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:46.968 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [945814381-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@59386ffc at consistency null
2022-03-21 04:08:46.968 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [945814381-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:47.376 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [736983432-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2e9b114d at consistency null
2022-03-21 04:08:47.376 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [736983432-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:47.377 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:08:52.448 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [915570673-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2aa65418 at consistency null
2022-03-21 04:08:52.448 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [915570673-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:52.547 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [487636601-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@783e32f4 at consistency null
2022-03-21 04:08:52.548 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [487636601-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:52.650 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1515432485-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6263e580 at consistency null
2022-03-21 04:08:52.650 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1515432485-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:52.747 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [439527902-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@148491f8 at consistency null
2022-03-21 04:08:52.748 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [439527902-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:52.864 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1064968350-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@c1a01e4 at consistency null
2022-03-21 04:08:52.864 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1064968350-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:53.048 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [654418558-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5ba2b01 at consistency null
2022-03-21 04:08:53.048 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [654418558-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:53.252 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1615078969-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@780891d3 at consistency null
2022-03-21 04:08:53.252 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1615078969-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:53.459 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1865879478-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4833c47b at consistency null
2022-03-21 04:08:53.459 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1865879478-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:53.666 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [19377182-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@147af9b8 at consistency null
2022-03-21 04:08:53.666 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [19377182-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:54.149 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [723512342-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@40cc3a15 at consistency null
2022-03-21 04:08:54.150 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [723512342-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:54.564 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1781232290-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7c76bdd6 at consistency null
2022-03-21 04:08:54.564 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1781232290-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:55.374 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1035373294-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2ab0be3f at consistency null
2022-03-21 04:08:55.374 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1035373294-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:56.189 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [30246426-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@69c425e8 at consistency null
2022-03-21 04:08:56.189 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [30246426-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:08:56.191 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:09:01.200 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1432794473-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@48f9a657 at consistency null
2022-03-21 04:09:01.201 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1432794473-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.233 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1693016837-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1a83a93 at consistency null
2022-03-21 04:09:01.233 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1693016837-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.267 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1828811916-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2ec62ddf at consistency null
2022-03-21 04:09:01.267 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1828811916-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.313 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1167968-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6665b68a at consistency null
2022-03-21 04:09:01.313 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1167968-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.343 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1622995702-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@632b7f0f at consistency null
2022-03-21 04:09:01.344 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1622995702-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.404 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1331844271-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2397ad5b at consistency null
2022-03-21 04:09:01.405 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1331844271-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.472 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [698481883-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3ca0c423 at consistency null
2022-03-21 04:09:01.472 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [698481883-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.530 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [657307997-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@77baf4db at consistency null
2022-03-21 04:09:01.530 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [657307997-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.588 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [536986636-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4f513e24 at consistency null
2022-03-21 04:09:01.588 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [536986636-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.644 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2098936719-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@51b2afe0 at consistency null
2022-03-21 04:09:01.644 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2098936719-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.706 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1543133139-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6b09e829 at consistency null
2022-03-21 04:09:01.706 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1543133139-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.811 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [299367072-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4b35c5bf at consistency null
2022-03-21 04:09:01.811 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [299367072-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:01.922 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1062763826-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@495a1116 at consistency null
2022-03-21 04:09:01.922 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1062763826-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:02.127 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [456912405-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6db6e0b4 at consistency null
2022-03-21 04:09:02.127 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [456912405-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:02.532 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [309749358-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@8cbc880 at consistency null
2022-03-21 04:09:02.532 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [309749358-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:02.944 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1020959866-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1e197700 at consistency null
2022-03-21 04:09:02.944 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1020959866-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:03.353 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1075304254-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7d20774 at consistency null
2022-03-21 04:09:03.354 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1075304254-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:04.159 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [77120111-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5dbbf47a at consistency null
2022-03-21 04:09:04.159 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [77120111-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:04.162 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:09:06.433 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:09:06.450 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:09:09.168 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [628920708-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@b62a885 at consistency null
2022-03-21 04:09:09.168 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [628920708-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.200 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1294856221-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5e166f9e at consistency null
2022-03-21 04:09:09.200 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1294856221-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.232 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [872243361-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@49682a8f at consistency null
2022-03-21 04:09:09.232 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [872243361-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.262 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1907640075-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4b720ffc at consistency null
2022-03-21 04:09:09.262 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1907640075-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.291 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [805636104-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@55cab097 at consistency null
2022-03-21 04:09:09.291 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [805636104-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.321 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [302693133-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@384d4f2f at consistency null
2022-03-21 04:09:09.321 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [302693133-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.351 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1252669829-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@30f936fb at consistency null
2022-03-21 04:09:09.351 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1252669829-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.385 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [435532740-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6bafd2f7 at consistency null
2022-03-21 04:09:09.385 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [435532740-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.440 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [27835834-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6be1991d at consistency null
2022-03-21 04:09:09.440 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [27835834-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.495 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1186839633-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@39079779 at consistency null
2022-03-21 04:09:09.495 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1186839633-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.553 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1564529426-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@40b0204c at consistency null
2022-03-21 04:09:09.553 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1564529426-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.609 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1772036333-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@559d7ac7 at consistency null
2022-03-21 04:09:09.609 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1772036333-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.715 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [765334793-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@32d32818 at consistency null
2022-03-21 04:09:09.715 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [765334793-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.821 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [116026335-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@37eacd64 at consistency null
2022-03-21 04:09:09.821 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [116026335-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:09.937 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1567219795-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@76992995 at consistency null
2022-03-21 04:09:09.938 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1567219795-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:10.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1306602331-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@486c2ec3 at consistency null
2022-03-21 04:09:10.146 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1306602331-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:10.354 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [277502387-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@63544c3e at consistency null
2022-03-21 04:09:10.354 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [277502387-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:10.759 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1173056750-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2342cdd at consistency null
2022-03-21 04:09:10.760 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1173056750-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:11.167 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1460828024-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3d5e688f at consistency null
2022-03-21 04:09:11.167 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1460828024-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:11.572 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [325920050-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@14ed43d1 at consistency null
2022-03-21 04:09:11.572 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [325920050-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:11.978 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1374200109-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5519d8ce at consistency null
2022-03-21 04:09:11.979 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1374200109-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:12.788 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1333406690-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@76684474 at consistency null
2022-03-21 04:09:12.788 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1333406690-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:12.790 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:09:17.849 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [194456770-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@38bc4026 at consistency null
2022-03-21 04:09:17.849 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [194456770-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:17.948 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1906953271-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@46b16f2b at consistency null
2022-03-21 04:09:17.949 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1906953271-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:18.053 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1708980966-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5df5109b at consistency null
2022-03-21 04:09:18.054 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1708980966-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:18.263 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2078795908-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@698aa4b5 at consistency null
2022-03-21 04:09:18.263 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2078795908-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:18.548 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1227106822-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@336d74d2 at consistency null
2022-03-21 04:09:18.548 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1227106822-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:18.760 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1985191777-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7e689da3 at consistency null
2022-03-21 04:09:18.760 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1985191777-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:19.254 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1960460423-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@b6c2b3d at consistency null
2022-03-21 04:09:19.255 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1960460423-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:20.064 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [809313616-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@377f89e9 at consistency null
2022-03-21 04:09:20.065 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [809313616-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:20.949 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1478577483-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6f6cb030 at consistency null
2022-03-21 04:09:20.950 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1478577483-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:20.951 WARN 10 --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2022-03-21T04:07:31.274Z] (this read will be retried)
org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55)
... 9 common frames omitted
Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126)
at io.vavr.API$Match$Case0.apply(API.java:3174)
at io.vavr.API$Match.of(API.java:3137)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123)
at io.vavr.control.Try.getOrElseThrow(Try.java:671)
at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798)
at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795)
at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148)
at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162)
at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69)
... 10 common frames omitted
Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476)
at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455)
at io.vavr.control.Try.of(Try.java:62)
at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
... 3 common frames omitted
Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.233.69.27:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)))
at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265)
at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521)
at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:287)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:321)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:295)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:355)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:377)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:363)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
... 1 common frames omitted
2022-03-21 04:09:25.957 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [853768633-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@55d3bdfb at consistency null
2022-03-21 04:09:25.957 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [853768633-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:26.050 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [345757978-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3f8c41bf at consistency null
2022-03-21 04:09:26.051 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [345757978-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:26.157 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1297447292-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@74f7b766 at consistency null
2022-03-21 04:09:26.157 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1297447292-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:26.263 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [525086344-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7e1064f8 at consistency null
2022-03-21 04:09:26.264 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [525086344-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:26.470 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [910930537-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@36e432a4 at consistency null
2022-03-21 04:09:26.470 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [910930537-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:26.749 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2085809843-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6b381c7e at consistency null
2022-03-21 04:09:26.750 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2085809843-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:27.162 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [439019228-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@22bdcaf8 at consistency null
2022-03-21 04:09:27.162 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [439019228-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:27.970 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1684841343-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5f775df3 at consistency null
2022-03-21 04:09:27.970 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1684841343-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:28.775 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [266313057-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@489125ab at consistency null
2022-03-21 04:09:28.775 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [266313057-0] Error querying /10.233.69.27:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive)
2022-03-21 04:09:30.249 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:09:30.256 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-17, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:09:30.257 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-17, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:09:30.257 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-17, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:09:30.257 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-17, inFlight=0, closed=true] closing connection
2022-03-21 04:09:30.258 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:09:30.258 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-03-21 04:09:30.258 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 128000 ms
2022-03-21 04:09:36.460 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:09:36.463 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:09:43.132 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:09:43.135 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-17, inFlight=0, closed=false] Error connecting to /10.233.71.20:9042 (Connection refused: /10.233.71.20:9042)
2022-03-21 04:09:43.135 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.233.71.20:9042-17, inFlight=0, closed=false] because: [/10.233.71.20:9042] Cannot connect
2022-03-21 04:09:43.135 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-17, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:09:43.136 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-17, inFlight=0, closed=true] closing connection
2022-03-21 04:09:43.136 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.233.71.20:9042
2022-03-21 04:09:43.137 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.233.71.20:9042 ([/10.233.71.20:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-03-21 04:09:43.137 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] next reconnection attempt in 128000 ms
2022-03-21 04:09:46.950 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.71.20:9042, scheduling delivery
2022-03-21 04:09:46.951 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] received event UP
2022-03-21 04:09:47.951 DEBUG 10 --- [uster-worker-12] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on /10.233.71.20:9042
2022-03-21 04:09:48.054 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] marking host UP
2022-03-21 04:09:48.055 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-03-21 04:09:48.055 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.233.71.20:9042
2022-03-21 04:09:48.055 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:09:48.058 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:09:51.571 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 04:09:51.887 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.70.52:9042, scheduling delivery
2022-03-21 04:09:51.887 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.70.52:9042] received event UP
2022-03-21 04:09:52.888 DEBUG 10 --- [uster-worker-13] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on cassandra/10.233.70.52:9042
2022-03-21 04:09:52.956 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] marking host UP
2022-03-21 04:09:52.956 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-03-21 04:09:52.956 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node cassandra/10.233.70.52:9042
2022-03-21 04:09:52.956 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:09:52.960 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:09:52.968 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Host.STATES : [/10.233.71.20:9042] preparing to open 0 new connections, total = 1
2022-03-21 04:09:52.968 DEBUG 10 --- [uster-worker-12] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.233.71.20:9042 (1 connections needed, 1 successfully opened)
2022-03-21 04:09:52.969 DEBUG 10 --- [uster-worker-12] com.datastax.driver.core.Session : Added connection pool for /10.233.71.20:9042
2022-03-21 04:10:00.300 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 04:10:01.201 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 0 new connections, total = 1
2022-03-21 04:10:01.201 DEBUG 10 --- [uster-worker-13] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.233.70.52:9042 (1 connections needed, 1 successfully opened)
2022-03-21 04:10:01.201 DEBUG 10 --- [uster-worker-13] com.datastax.driver.core.Session : Added connection pool for cassandra/10.233.70.52:9042
2022-03-21 04:10:20.880 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:10:20.953 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:10:22.956 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:10:22.959 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:10:52.530 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:10:52.960 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:10:52.966 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:10:53.293 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:11:22.967 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:11:22.973 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:11:34.206 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:11:34.297 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:11:52.974 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:11:52.980 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:12:22.980 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:12:23.062 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:12:30.298 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:12:30.301 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:12:35.396 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:12:35.885 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:12:53.064 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:12:53.071 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:13:12.490 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:13:12.495 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:13:23.078 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:13:23.083 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:13:33.609 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:13:33.809 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:13:53.084 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:13:53.170 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:14:19.494 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:14:19.500 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:14:23.175 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:14:23.180 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:14:53.181 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:14:53.268 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:15:00.426 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:15:00.435 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:15:23.269 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:15:23.295 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:15:51.634 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:15:51.715 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:15:53.296 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:15:53.370 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:16:23.371 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:16:23.383 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:16:53.384 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:16:53.388 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:17:13.930 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:17:14.115 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:17:23.390 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:17:23.398 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:17:53.398 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:17:53.477 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:18:04.936 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:18:05.217 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:18:23.478 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:18:23.485 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:18:30.519 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:18:30.524 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:18:51.634 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:18:51.825 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:18:53.486 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:18:53.495 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:19:23.495 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:19:23.498 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:19:32.742 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:19:32.927 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:19:37.824 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:19:37.895 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:19:53.504 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:19:53.508 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:20:14.247 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:20:14.330 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:20:23.510 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:20:23.589 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:20:53.593 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:20:53.600 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:21:10.318 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:21:10.338 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:21:23.602 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:21:23.691 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:21:40.344 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:21:40.351 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:21:53.694 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:21:53.699 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:22:19.711 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:22:19.790 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:22:23.700 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:22:23.792 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:22:53.793 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:22:53.797 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:22:56.594 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.70.52:9042, scheduling delivery
2022-03-21 04:22:56.595 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.70.52:9042] received event DOWN
2022-03-21 04:22:56.750 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-03-21 04:22:56.751 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-03-21 04:22:56.752 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preventing new connections for the next 1000 ms
2022-03-21 04:22:56.752 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:22:56.762 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] marking host DOWN
2022-03-21 04:22:56.762 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-18, inFlight=0, closed=true] closing connection
2022-03-21 04:22:56.764 DEBUG 10 --- [uster-worker-14] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-03-21 04:22:56.764 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] starting reconnection attempt
2022-03-21 04:22:57.597 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:22:57.764 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:22:57.773 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-19, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:22:57.773 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-19, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:22:57.773 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-19, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:22:57.774 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-19, inFlight=0, closed=true] closing connection
2022-03-21 04:22:57.774 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:22:57.775 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-03-21 04:22:57.775 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 2000 ms
2022-03-21 04:22:59.775 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:22:59.779 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-20, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:22:59.779 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-20, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:22:59.779 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-20, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:22:59.779 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-20, inFlight=0, closed=true] closing connection
2022-03-21 04:22:59.779 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:22:59.779 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-03-21 04:22:59.779 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 4000 ms
2022-03-21 04:23:02.731 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:23:02.735 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:23:03.780 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:23:03.786 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-21, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:23:03.786 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-21, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:23:03.787 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-21, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:23:03.787 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-21, inFlight=0, closed=true] closing connection
2022-03-21 04:23:03.787 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:23:03.788 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-03-21 04:23:03.788 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 8000 ms
2022-03-21 04:23:11.789 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:23:11.797 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-22, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:23:11.797 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-22, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:23:11.797 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-22, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:23:11.798 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-22, inFlight=0, closed=true] closing connection
2022-03-21 04:23:11.798 DEBUG 10 --- [uster-worker-15] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:23:11.798 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-03-21 04:23:11.798 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 16000 ms
2022-03-21 04:23:26.599 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:23:26.603 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:23:27.799 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:23:27.802 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-23, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:23:27.803 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-23, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:23:27.803 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-23, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:23:27.803 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-23, inFlight=0, closed=true] closing connection
2022-03-21 04:23:27.804 DEBUG 10 --- [uster-worker-14] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:23:27.804 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-03-21 04:23:27.804 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 32000 ms
2022-03-21 04:23:28.807 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:23:28.817 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:23:56.618 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:23:56.705 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:23:59.804 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:23:59.813 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-24, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:23:59.814 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-24, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:23:59.814 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-24, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:23:59.815 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-24, inFlight=0, closed=true] closing connection
2022-03-21 04:23:59.815 DEBUG 10 --- [uster-worker-16] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:23:59.815 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-03-21 04:23:59.816 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 64000 ms
2022-03-21 04:24:26.706 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:24:26.710 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:24:50.035 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:24:50.045 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:24:56.735 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:24:56.798 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:25:03.816 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:25:03.823 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-25, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:25:03.824 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-25, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:25:03.824 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-25, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:25:03.825 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-25, inFlight=0, closed=true] closing connection
2022-03-21 04:25:03.826 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-03-21 04:25:03.826 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 128000 ms
2022-03-21 04:25:03.826 DEBUG 10 --- [uster-worker-17] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:25:15.522 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:25:15.620 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:25:26.799 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:25:26.804 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:25:56.829 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:25:56.900 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:26:26.901 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:26:26.906 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:26:56.932 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:26:57.004 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:27:11.826 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:27:11.831 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-26, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:27:11.831 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-26, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:27:11.832 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-26, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:27:11.836 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-26, inFlight=0, closed=true] closing connection
2022-03-21 04:27:11.836 DEBUG 10 --- [uster-worker-18] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:27:11.836 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 256000 milliseconds
2022-03-21 04:27:11.837 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 256000 ms
2022-03-21 04:27:27.005 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:27:27.025 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:27:57.033 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:27:57.123 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:28:27.124 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:28:27.208 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:28:36.268 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.70.52:9042, scheduling delivery
2022-03-21 04:28:36.269 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.70.52:9042] received event UP
2022-03-21 04:28:37.271 DEBUG 10 --- [uster-worker-19] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on cassandra/10.233.70.52:9042
2022-03-21 04:28:37.283 DEBUG 10 --- [uster-worker-19] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] marking host UP
2022-03-21 04:28:37.283 DEBUG 10 --- [uster-worker-19] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-03-21 04:28:37.283 DEBUG 10 --- [uster-worker-19] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node cassandra/10.233.70.52:9042
2022-03-21 04:28:37.283 DEBUG 10 --- [uster-worker-19] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:28:37.287 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-27, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:28:49.293 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-27, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Operation timed out
2022-03-21 04:28:49.293 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-27, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:28:49.295 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-27, inFlight=0, closed=true] closing connection
2022-03-21 04:28:49.295 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.233.70.52:9042-27, inFlight=0, closed=true]: there are still pending requests
2022-03-21 04:28:49.297 DEBUG 10 --- [uster-worker-19] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:28:49.301 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-28, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:29:03.892 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-28, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Operation timed out
2022-03-21 04:29:03.892 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-28, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:29:03.892 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-28, inFlight=0, closed=true] closing connection
2022-03-21 04:29:03.892 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.233.70.52:9042-28, inFlight=0, closed=true]: there are still pending requests
2022-03-21 04:29:03.904 WARN 10 --- [ter-timeouter-0] c.d.driver.core.HostConnectionPool : Error creating connection to cassandra/10.233.70.52:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [cassandra/10.233.70.52:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1496)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1575)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:672)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:747)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:472)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-03-21 04:29:03.905 DEBUG 10 --- [ter-timeouter-0] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.233.70.52:9042 (1 connections needed, 0 successfully opened)
2022-03-21 04:29:03.905 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Session : Added connection pool for cassandra/10.233.70.52:9042
2022-03-21 04:29:03.905 DEBUG 10 --- [uster-worker-20] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] marking host DOWN
2022-03-21 04:29:03.906 DEBUG 10 --- [uster-worker-20] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-03-21 04:29:03.906 DEBUG 10 --- [uster-worker-20] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] starting reconnection attempt
2022-03-21 04:29:03.906 DEBUG 10 --- [uster-worker-19] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:29:04.906 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:29:04.913 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-29, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:29:07.290 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:29:07.299 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:29:14.243 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-27, inFlight=0, closed=true] has already terminated
2022-03-21 04:29:27.191 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-29, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Operation timed out
2022-03-21 04:29:27.192 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-29, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:29:27.192 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-29, inFlight=0, closed=true] closing connection
2022-03-21 04:29:27.192 DEBUG 10 --- [uster-worker-20] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:29:27.192 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.233.70.52:9042-29, inFlight=0, closed=true]: there are still pending requests
2022-03-21 04:29:27.192 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Operation timed out), scheduling retry in 2000 milliseconds
2022-03-21 04:29:27.192 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 2000 ms
2022-03-21 04:29:29.193 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:29:29.200 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-30, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:29:29.244 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-28, inFlight=0, closed=true] has already terminated
2022-03-21 04:29:37.318 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:29:37.323 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:29:41.392 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-30, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Operation timed out
2022-03-21 04:29:41.392 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-30, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:29:41.393 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-30, inFlight=0, closed=true] closing connection
2022-03-21 04:29:41.393 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.233.70.52:9042-30, inFlight=0, closed=true]: there are still pending requests
2022-03-21 04:29:41.393 DEBUG 10 --- [uster-worker-21] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:29:41.394 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Operation timed out), scheduling retry in 4000 milliseconds
2022-03-21 04:29:41.394 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 4000 ms
2022-03-21 04:29:45.394 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:29:45.398 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-31, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:29:58.591 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-31, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Operation timed out
2022-03-21 04:29:58.592 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-31, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:29:58.592 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-31, inFlight=0, closed=true] closing connection
2022-03-21 04:29:58.593 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.233.70.52:9042-31, inFlight=0, closed=true]: there are still pending requests
2022-03-21 04:29:58.593 DEBUG 10 --- [uster-worker-22] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:29:58.593 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Operation timed out), scheduling retry in 8000 milliseconds
2022-03-21 04:29:58.593 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 8000 ms
2022-03-21 04:29:59.248 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-29, inFlight=0, closed=true] has already terminated
2022-03-21 04:30:06.594 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:30:06.599 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-32, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:30:07.327 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:30:07.337 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:30:14.250 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-30, inFlight=0, closed=true] has already terminated
2022-03-21 04:30:19.191 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-32, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Operation timed out
2022-03-21 04:30:19.192 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-32, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:30:19.192 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-32, inFlight=0, closed=true] closing connection
2022-03-21 04:30:19.192 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.233.70.52:9042-32, inFlight=0, closed=true]: there are still pending requests
2022-03-21 04:30:19.192 DEBUG 10 --- [uster-worker-23] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:30:19.193 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Operation timed out), scheduling retry in 16000 milliseconds
2022-03-21 04:30:19.193 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 16000 ms
2022-03-21 04:30:29.250 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-31, inFlight=0, closed=true] has already terminated
2022-03-21 04:30:35.193 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:30:35.201 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-33, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:30:37.354 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:30:37.358 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:30:44.251 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-32, inFlight=0, closed=true] has already terminated
2022-03-21 04:30:49.392 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-33, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Operation timed out
2022-03-21 04:30:49.392 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-33, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:30:49.393 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-33, inFlight=0, closed=true] closing connection
2022-03-21 04:30:49.393 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.233.70.52:9042-33, inFlight=0, closed=true]: there are still pending requests
2022-03-21 04:30:49.393 DEBUG 10 --- [uster-worker-24] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:30:49.393 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Operation timed out), scheduling retry in 32000 milliseconds
2022-03-21 04:30:49.393 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 32000 ms
2022-03-21 04:31:07.383 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:31:07.387 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:31:14.252 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-33, inFlight=0, closed=true] has already terminated
2022-03-21 04:31:21.394 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:31:21.396 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-34, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:31:33.992 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-34, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Operation timed out
2022-03-21 04:31:33.992 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-34, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:31:33.993 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-34, inFlight=0, closed=true] closing connection
2022-03-21 04:31:33.993 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.233.70.52:9042-34, inFlight=0, closed=true]: there are still pending requests
2022-03-21 04:31:33.993 DEBUG 10 --- [uster-worker-25] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:31:33.994 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Operation timed out), scheduling retry in 64000 milliseconds
2022-03-21 04:31:33.994 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 64000 ms
2022-03-21 04:31:37.411 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:31:37.415 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:31:59.253 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-34, inFlight=0, closed=true] has already terminated
2022-03-21 04:32:07.442 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:32:07.447 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:32:37.470 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:32:37.474 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:32:37.994 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:32:38.008 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-35, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:32:52.492 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-35, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Operation timed out
2022-03-21 04:32:52.492 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-35, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:32:52.494 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-35, inFlight=0, closed=true] closing connection
2022-03-21 04:32:52.494 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.233.70.52:9042-35, inFlight=0, closed=true]: there are still pending requests
2022-03-21 04:32:52.494 DEBUG 10 --- [uster-worker-26] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:32:52.494 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Operation timed out), scheduling retry in 128000 milliseconds
2022-03-21 04:32:52.494 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 128000 ms
2022-03-21 04:33:07.487 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:33:07.497 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:33:29.257 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-35, inFlight=0, closed=true] has already terminated
2022-03-21 04:33:37.515 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:33:37.519 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:34:07.526 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:34:07.530 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:34:19.637 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:34:19.651 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:34:37.557 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:34:37.562 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:35:00.497 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:35:00.502 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-36, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:35:07.586 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:35:07.591 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:35:12.592 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-36, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Operation timed out
2022-03-21 04:35:12.593 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-36, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:35:12.594 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-36, inFlight=0, closed=true] closing connection
2022-03-21 04:35:12.594 DEBUG 10 --- [uster-worker-27] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:35:12.594 DEBUG 10 --- [ter-timeouter-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.233.70.52:9042-36, inFlight=0, closed=true]: there are still pending requests
2022-03-21 04:35:12.595 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Operation timed out), scheduling retry in 256000 milliseconds
2022-03-21 04:35:12.595 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 256000 ms
2022-03-21 04:35:37.605 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:35:37.609 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:35:44.264 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-36, inFlight=0, closed=true] has already terminated
2022-03-21 04:36:07.621 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:36:07.627 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:36:11.354 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:36:11.360 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:36:37.647 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:36:37.654 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:37:07.674 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:37:07.679 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:37:37.703 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:37:37.709 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:38:07.730 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:38:07.735 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:38:37.758 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:38:37.764 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:38:39.210 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.70.52:9042, scheduling delivery
2022-03-21 04:38:39.210 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.70.52:9042] received event DOWN
2022-03-21 04:38:40.213 DEBUG 10 --- [uster-worker-28] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:39:09.213 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:39:09.218 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:39:28.596 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:39:28.602 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-37, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:39:28.603 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-37, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:39:28.603 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-37, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:39:28.604 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-37, inFlight=0, closed=true] closing connection
2022-03-21 04:39:28.606 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 512000 milliseconds
2022-03-21 04:39:28.606 DEBUG 10 --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 512000 ms
2022-03-21 04:39:28.606 DEBUG 10 --- [uster-worker-29] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:39:39.244 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:39:39.248 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:40:09.274 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:40:09.277 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:40:39.304 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:40:39.307 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:41:09.335 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:41:09.347 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:41:39.366 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:41:39.379 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:41:56.472 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:41:56.550 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:42:09.395 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:42:09.398 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:42:39.404 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:42:39.418 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:43:09.430 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:43:09.444 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:43:12.300 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:43:12.306 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:43:39.459 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:43:39.473 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:44:03.003 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:44:03.008 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:44:09.487 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:44:09.493 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:44:17.424 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT UP /10.233.70.52:9042, scheduling delivery
2022-03-21 04:44:17.425 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.70.52:9042] received event UP
2022-03-21 04:44:18.426 DEBUG 10 --- [uster-worker-30] c.d.driver.core.ControlConnection : [Control connection] Refreshing node info on cassandra/10.233.70.52:9042
2022-03-21 04:44:18.470 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] marking host UP
2022-03-21 04:44:18.470 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP
2022-03-21 04:44:18.470 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node cassandra/10.233.70.52:9042
2022-03-21 04:44:18.470 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:44:18.475 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=0, closed=false] Connection established, initializing transport
2022-03-21 04:44:40.726 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-38, inFlight=0, closed=false] Transport initialized, connection ready
2022-03-21 04:44:42.726 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 0 new connections, total = 1
2022-03-21 04:44:42.727 DEBUG 10 --- [uster-worker-30] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.233.70.52:9042 (1 connections needed, 1 successfully opened)
2022-03-21 04:44:42.727 DEBUG 10 --- [uster-worker-30] com.datastax.driver.core.Session : Added connection pool for cassandra/10.233.70.52:9042
2022-03-21 04:44:48.479 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:44:48.559 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:44:59.300 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:44:59.306 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:45:18.561 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:45:18.563 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:45:27.070 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:45:27.075 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:45:47.820 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:45:48.591 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:45:48.595 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:45:50.625 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:46:02.986 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:46:02.990 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:46:18.613 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:46:18.663 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:46:33.015 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:46:33.018 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:46:48.664 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:46:48.686 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:47:02.132 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:47:02.223 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:47:18.691 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:47:18.767 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:47:27.494 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:47:27.498 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:47:48.768 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:47:48.777 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:48:18.782 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:48:18.788 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:48:28.847 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:48:29.429 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:48:33.991 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:48:34.084 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:48:48.788 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:48:48.879 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:49:18.879 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:49:18.885 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:49:24.796 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:49:24.802 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:49:48.903 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:49:48.975 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:50:00.406 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:50:00.410 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:50:15.650 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:50:15.839 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=1, closed=false] heartbeat query succeeded
2022-03-21 04:50:18.976 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:50:18.981 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:50:48.992 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:50:48.996 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:50:55.998 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:50:56.002 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:51:11.414 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:51:11.419 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:51:19.007 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:51:19.079 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:51:37.347 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:51:41.945 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=1, closed=false] heartbeat query succeeded
2022-03-21 04:51:49.080 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:51:49.085 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:51:52.505 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:51:52.580 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:52:19.106 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:52:19.185 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:52:48.523 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:52:48.583 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:52:49.187 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:52:49.190 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:53:18.583 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:53:18.595 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:53:19.214 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:53:19.287 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:53:49.287 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:53:49.290 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:54:19.311 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:54:19.388 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:54:24.919 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:54:24.996 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:54:32.806 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.233.70.52:9042, scheduling delivery
2022-03-21 04:54:32.806 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.233.70.52:9042] received event DOWN
2022-03-21 04:54:33.355 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=1, closed=false] connection error
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
at sun.nio.ch.IOUtil.read(IOUtil.java:192)
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
at io.netty.buffer.PooledByteBuf.setBytes(PooledByteBuf.java:253)
at io.netty.buffer.AbstractByteBuf.writeBytes(AbstractByteBuf.java:1133)
at io.netty.channel.socket.nio.NioSocketChannel.doReadBytes(NioSocketChannel.java:350)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:148)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:576)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2022-03-21 04:54:33.355 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-38, inFlight=1, closed=false] because: [cassandra/10.233.70.52:9042] Unexpected exception triggered (java.io.IOException: Connection reset by peer)
2022-03-21 04:54:33.355 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preventing new connections for the next 1000 ms
2022-03-21 04:54:33.356 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-38, inFlight=1, closed=false] failed, remaining = 0
2022-03-21 04:54:33.356 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=1, closed=true] closing connection
2022-03-21 04:54:33.356 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Not terminating Connection[cassandra/10.233.70.52:9042-38, inFlight=1, closed=true]: there are still pending requests
2022-03-21 04:54:33.357 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] marking host DOWN
2022-03-21 04:54:33.357 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.RequestHandler : onException triggered but the response was completed by another thread, cancelling (retryCount = 0, queryState = QueryState(count=0, inProgress=false, cancelled=false), queryStateRef = QueryState(count=0, inProgress=false, cancelled=false))
2022-03-21 04:54:33.359 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1630841227-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3693b3e1 at consistency LOCAL_QUORUM
2022-03-21 04:54:33.359 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [1630841227-0] Error querying cassandra/10.233.70.52:9042 : com.datastax.driver.core.exceptions.TransportException: [cassandra/10.233.70.52:9042] Connection has been closed
2022-03-21 04:54:33.361 DEBUG 10 --- [uster-worker-31] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms
2022-03-21 04:54:33.361 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] starting reconnection attempt
2022-03-21 04:54:33.807 DEBUG 10 --- [uster-worker-32] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:54:34.361 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:54:34.368 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-39, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:54:34.368 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-39, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:54:34.369 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-39, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:54:34.369 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-39, inFlight=0, closed=true] closing connection
2022-03-21 04:54:34.369 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:54:34.370 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 2000 milliseconds
2022-03-21 04:54:34.370 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 2000 ms
2022-03-21 04:54:35.510 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:54:35.526 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:54:36.370 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:54:36.373 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-40, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:54:36.374 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-40, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:54:36.374 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-40, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:54:36.374 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-40, inFlight=0, closed=true] closing connection
2022-03-21 04:54:36.374 DEBUG 10 --- [uster-worker-32] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:54:36.375 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 4000 milliseconds
2022-03-21 04:54:36.375 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 4000 ms
2022-03-21 04:54:40.375 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:54:40.379 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-41, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:54:40.379 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-41, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:54:40.379 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-41, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:54:40.379 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-41, inFlight=0, closed=true] closing connection
2022-03-21 04:54:40.379 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:54:40.380 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 8000 milliseconds
2022-03-21 04:54:40.380 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 8000 ms
2022-03-21 04:54:48.380 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:54:48.384 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-42, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:54:48.385 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-42, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:54:48.385 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-42, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:54:48.385 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-42, inFlight=0, closed=true] closing connection
2022-03-21 04:54:48.385 DEBUG 10 --- [uster-worker-32] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:54:48.386 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 16000 milliseconds
2022-03-21 04:54:48.386 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 16000 ms
2022-03-21 04:54:59.310 DEBUG 10 --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-38, inFlight=0, closed=true] has already terminated
2022-03-21 04:55:02.815 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:55:02.818 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:55:04.387 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:55:04.392 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-43, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:55:04.392 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-43, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:55:04.392 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-43, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:55:04.392 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-43, inFlight=0, closed=true] closing connection
2022-03-21 04:55:04.393 DEBUG 10 --- [uster-worker-31] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:55:04.393 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 32000 milliseconds
2022-03-21 04:55:04.393 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 32000 ms
2022-03-21 04:55:32.843 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:55:32.847 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:55:33.929 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:55:34.013 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:55:36.394 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:55:36.398 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-44, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:55:36.398 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-44, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:55:36.398 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-44, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:55:36.399 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-44, inFlight=0, closed=true] closing connection
2022-03-21 04:55:36.399 DEBUG 10 --- [uster-worker-33] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:55:36.399 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 64000 milliseconds
2022-03-21 04:55:36.399 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 64000 ms
2022-03-21 04:56:02.863 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:56:02.867 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:56:32.893 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:56:32.918 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:56:40.399 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:56:40.410 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-45, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:56:40.410 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-45, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:56:40.410 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-45, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:56:40.411 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-45, inFlight=0, closed=true] closing connection
2022-03-21 04:56:40.411 DEBUG 10 --- [uster-worker-34] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:56:40.412 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 128000 milliseconds
2022-03-21 04:56:40.412 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 128000 ms
2022-03-21 04:57:02.922 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:57:02.927 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:57:32.950 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:57:33.024 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:58:03.026 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:58:03.104 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:58:33.105 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:58:33.308 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:58:48.412 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 04:58:48.418 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-46, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 04:58:48.419 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-46, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 04:58:48.419 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-46, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 04:58:48.420 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-46, inFlight=0, closed=true] closing connection
2022-03-21 04:58:48.420 DEBUG 10 --- [uster-worker-35] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 04:58:48.420 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 256000 milliseconds
2022-03-21 04:58:48.420 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 256000 ms
2022-03-21 04:59:03.311 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:59:03.315 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 04:59:33.340 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 04:59:33.345 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:00:03.370 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:00:03.377 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:00:13.045 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:00:13.051 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:00:33.399 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:00:33.415 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:00:53.621 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:00:53.726 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:01:03.416 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:01:03.420 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:01:33.435 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:01:33.511 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:02:03.512 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:02:03.520 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:02:25.154 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:02:25.162 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:02:33.542 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:02:33.616 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:03:03.617 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:03:03.621 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:03:04.422 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 05:03:04.432 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-47, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 05:03:04.432 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-47, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 05:03:04.432 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-47, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 05:03:04.433 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-47, inFlight=0, closed=true] closing connection
2022-03-21 05:03:04.433 DEBUG 10 --- [uster-worker-36] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 05:03:04.433 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 512000 milliseconds
2022-03-21 05:03:04.433 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 512000 ms
2022-03-21 05:03:33.648 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:03:33.656 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:04:03.658 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:04:03.719 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:04:33.721 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:04:33.727 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:04:37.543 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:04:37.548 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:05:03.750 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:05:03.755 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:05:33.781 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:05:33.785 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:06:03.810 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:06:03.815 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:06:33.835 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:06:33.839 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:06:39.164 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:06:39.169 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:07:03.864 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:07:03.868 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:07:33.894 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:07:33.933 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:08:03.934 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:08:03.938 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:08:21.176 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:08:21.190 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:08:33.944 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:08:33.951 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:09:03.974 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:09:03.986 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:09:22.554 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:09:22.561 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:09:34.003 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:09:34.045 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:10:04.046 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:10:04.056 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:10:34.074 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:10:34.078 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:10:59.478 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:10:59.556 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:11:04.089 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:11:04.093 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:11:34.118 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:11:34.123 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:11:36.434 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 05:11:36.440 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-48, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 05:11:36.441 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-48, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 05:11:36.441 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-48, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 05:11:36.441 DEBUG 10 --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-48, inFlight=0, closed=true] closing connection
2022-03-21 05:11:36.442 DEBUG 10 --- [uster-worker-37] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 05:11:36.442 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 600000 milliseconds
2022-03-21 05:11:36.443 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 600000 ms
2022-03-21 05:12:04.136 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:12:04.139 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:12:34.147 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:12:34.151 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:13:04.166 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:13:04.170 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:13:34.174 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:13:34.181 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:14:04.191 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:14:04.197 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:14:34.218 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:14:34.280 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:14:47.592 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:14:47.672 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:15:04.282 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:15:04.353 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:15:34.353 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:15:34.370 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:16:04.382 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:16:04.386 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:16:34.410 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:16:34.414 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:17:04.438 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:17:04.444 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:17:34.467 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:17:34.471 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:18:00.402 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:18:00.408 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.233.71.20:9042-18, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:18:04.479 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:18:04.482 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:18:34.504 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:18:34.511 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:19:04.534 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:19:04.538 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:19:34.565 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:19:34.568 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:20:04.591 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:20:04.595 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:20:22.680 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:20:22.682 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:20:34.614 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:20:34.622 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:20:58.271 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:20:58.282 DEBUG 10 --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-1, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:21:04.644 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:21:04.648 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:21:34.663 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:21:34.667 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:21:36.443 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] preparing to open 1 new connections, total = 1
2022-03-21 05:21:36.463 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-49, inFlight=0, closed=false] Error connecting to cassandra/10.233.70.52:9042 (Connection refused: cassandra/10.233.70.52:9042)
2022-03-21 05:21:36.463 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.233.70.52:9042-49, inFlight=0, closed=false] because: [cassandra/10.233.70.52:9042] Cannot connect
2022-03-21 05:21:36.463 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] Connection[cassandra/10.233.70.52:9042-49, inFlight=0, closed=false] failed, remaining = 0
2022-03-21 05:21:36.464 DEBUG 10 --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.233.70.52:9042-49, inFlight=0, closed=true] closing connection
2022-03-21 05:21:36.464 DEBUG 10 --- [uster-worker-38] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.233.70.52:9042
2022-03-21 05:21:36.465 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.233.70.52:9042 ([cassandra/10.233.70.52:9042] Cannot connect), scheduling retry in 600000 milliseconds
2022-03-21 05:21:36.465 DEBUG 10 --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.233.70.52:9042] next reconnection attempt in 600000 ms
2022-03-21 05:22:04.668 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:22:04.672 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:22:34.697 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:22:34.705 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:23:04.726 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:23:04.731 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:23:34.754 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:23:34.758 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:24:04.782 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:24:04.789 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:24:34.796 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:24:34.800 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:25:04.822 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:25:04.830 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded
2022-03-21 05:25:34.852 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] was inactive for 30 seconds, sending heartbeat
2022-03-21 05:25:34.856 DEBUG 10 --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.233.69.27:9042-9, inFlight=0, closed=false] heartbeat query succeeded