By type
Project Build Version: 1.0.0 Thu Jul 29 07:29:50 UTC 2021 Starting /opt/app/aai-graphadmin/bin/createDBSchema.sh 2021-07-29 07:29:54.390 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:29:54.399 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:29:54.399 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:29:54.400 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:29:54.415 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/versions, BODY= 2021-07-29 07:29:54.577 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:29:54.578 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:29:54.578 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:29:54.578 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:29:54.944 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:29:55.129 INFO --- [ main] org.onap.aai.config.NodesConfiguration : Translator is SchemaServiceTranslator 2021-07-29 07:29:55.138 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Processing the translator 2021-07-29 07:29:55.139 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv11 2021-07-29 07:29:55.140 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:29:55.297 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:29:55.297 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:29:55.297 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:29:55.297 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:29:55.329 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:29:55.389 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:29:55.390 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:29:55.391 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:29:58.230 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 222 2021-07-29 07:29:58.277 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv12 2021-07-29 07:29:58.278 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:29:58.281 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:29:58.281 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:29:58.281 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:29:58.281 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:29:58.308 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:29:58.333 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:29:58.334 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:29:58.335 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:29:59.439 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 235 2021-07-29 07:29:59.457 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv13 2021-07-29 07:29:59.457 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:29:59.460 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:29:59.460 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:29:59.468 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:29:59.468 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:29:59.501 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:29:59.518 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:29:59.519 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:29:59.519 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:30:00.570 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 237 2021-07-29 07:30:00.587 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv14 2021-07-29 07:30:00.588 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:30:00.591 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:00.591 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:00.591 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:00.591 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:00.629 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:00.647 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:00.648 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:30:00.649 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:30:01.818 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 272 2021-07-29 07:30:01.833 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv15 2021-07-29 07:30:01.833 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:30:01.835 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:01.835 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:01.836 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:01.836 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:01.860 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:01.890 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:01.891 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:30:01.892 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:30:03.142 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 279 2021-07-29 07:30:03.157 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv16 2021-07-29 07:30:03.158 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:30:03.160 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:03.160 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:03.160 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:03.160 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:03.183 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:03.206 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:03.208 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:30:03.208 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:30:04.371 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281 2021-07-29 07:30:04.384 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv17 2021-07-29 07:30:04.384 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:30:04.387 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:04.387 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:04.387 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:04.387 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:04.412 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:04.430 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:04.430 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:30:04.430 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:30:06.034 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281 2021-07-29 07:30:06.054 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv18 2021-07-29 07:30:06.055 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:30:06.057 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:06.057 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:06.057 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:06.058 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:06.088 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:06.115 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:06.116 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:30:06.117 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:30:07.402 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 281 2021-07-29 07:30:07.415 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv19 2021-07-29 07:30:07.416 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:30:07.418 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:07.418 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:07.418 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:07.418 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:07.443 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:07.466 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:07.466 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:30:07.467 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:30:08.853 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 301 2021-07-29 07:30:08.866 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv20 2021-07-29 07:30:08.867 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:30:08.869 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:08.869 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:08.869 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:08.869 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:08.892 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:08.912 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:08.913 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:30:08.914 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:30:10.228 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 305 2021-07-29 07:30:10.241 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv21 2021-07-29 07:30:10.242 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:30:10.244 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:10.244 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:10.244 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:10.244 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:10.266 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:10.290 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:10.291 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:30:10.292 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:30:11.993 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 371 2021-07-29 07:30:12.008 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv22 2021-07-29 07:30:12.009 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:30:12.012 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:12.012 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:12.012 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:12.012 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:12.040 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:12.074 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:12.075 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:30:12.078 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:30:13.947 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378 2021-07-29 07:30:13.969 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Version being processedv23 2021-07-29 07:30:13.969 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Headers: {Accept=application/xml, Content-Type=application/xml} 2021-07-29 07:30:13.973 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:13.973 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:13.973 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:13.973 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:14.009 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:14.041 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:14.041 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Retrieved OXMs from SchemaService 2021-07-29 07:30:14.042 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Ingested the InputStream 2021-07-29 07:30:16.096 DEBUG --- [ main] org.onap.aai.nodes.NodeIngestor : Types size 378 2021-07-29 07:30:16.143 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Processing the translator 2021-07-29 07:30:16.144 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv11 2021-07-29 07:30:16.144 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.145 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v11, BODY= 2021-07-29 07:30:16.146 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.146 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.146 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.146 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.156 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.158 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.158 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.158 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv12 2021-07-29 07:30:16.158 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.159 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v12, BODY= 2021-07-29 07:30:16.160 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.160 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.160 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.160 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.167 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.169 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.169 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.170 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv13 2021-07-29 07:30:16.170 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.170 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v13, BODY= 2021-07-29 07:30:16.171 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.171 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.171 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.171 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.179 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.181 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.181 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.182 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv14 2021-07-29 07:30:16.182 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.182 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v14, BODY= 2021-07-29 07:30:16.183 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.183 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.183 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.183 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.194 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.198 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.198 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.198 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv15 2021-07-29 07:30:16.198 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.199 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v15, BODY= 2021-07-29 07:30:16.200 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.200 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.200 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.200 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.210 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.213 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.213 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.213 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv16 2021-07-29 07:30:16.214 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.214 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v16, BODY= 2021-07-29 07:30:16.215 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.216 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.216 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.216 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.225 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.228 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.228 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.228 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv17 2021-07-29 07:30:16.228 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.229 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v17, BODY= 2021-07-29 07:30:16.230 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.230 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.230 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.230 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.241 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.243 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.244 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.244 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv18 2021-07-29 07:30:16.244 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.244 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v18, BODY= 2021-07-29 07:30:16.245 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.245 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.246 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.246 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.254 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.257 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.258 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.258 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv19 2021-07-29 07:30:16.258 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.258 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v19, BODY= 2021-07-29 07:30:16.260 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.260 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.260 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.260 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.270 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.273 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.273 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.273 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv20 2021-07-29 07:30:16.273 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.274 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v20, BODY= 2021-07-29 07:30:16.275 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.275 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.275 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.275 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.285 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.288 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.288 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.288 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv21 2021-07-29 07:30:16.289 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.289 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v21, BODY= 2021-07-29 07:30:16.290 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.290 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.290 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.290 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.303 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.307 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.308 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.308 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv22 2021-07-29 07:30:16.308 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.309 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v22, BODY= 2021-07-29 07:30:16.310 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.310 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.310 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.310 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.323 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.328 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.329 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.329 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Version being processedv23 2021-07-29 07:30:16.329 DEBUG --- [ main] org.onap.aai.restclient.RestClient : Request Headers: {} 2021-07-29 07:30:16.329 DEBUG --- [ main] org.onap.aai.restclient.RestClient : METHOD=GET, URL=https://aai-schema-service.onap:8452/aai/schema-service/v1/edgerules?version=v23, BODY= 2021-07-29 07:30:16.331 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Checking for system property [partnerName] 2021-07-29 07:30:16.331 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : System property was null or empty. Checking environment variable for: partnerName 2021-07-29 07:30:16.331 INFO --- [ main] org.onap.logging.filter.base.MDCSetup : Environment variable: partnerName was null or empty 2021-07-29 07:30:16.331 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : Invoke 2021-07-29 07:30:16.343 INFO --- [ main] o.o.l.f.base.AbstractMetricLogFilter : InvokeReturn 2021-07-29 07:30:16.349 DEBUG --- [ main] o.o.aai.setup.SchemaServiceTranslator : SchemaResponse Status code200 OK 2021-07-29 07:30:16.349 DEBUG --- [ main] org.onap.aai.edges.EdgeIngestor : Retrieved json from SchemaService 2021-07-29 07:30:16.684 INFO --- [ main] org.onap.aai.util.AAIConfig : Initializing AAIConfig 2021-07-29 07:30:16.685 DEBUG --- [ main] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-graphadmin/resources/etc/appprops/aaiconfig.properties 2021-07-29 07:30:16.685 INFO --- [ main] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-graphadmin/resources/etc/appprops/aaiconfig.properties 2021-07-29 07:30:16.686 INFO --- [ main] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename ---- NOTE --- about to open graph (takes a little while)--------; 2021-07-29 07:30:17.140 INFO --- [ main] com.datastax.driver.core : DataStax Java driver 3.6.0 for Apache Cassandra 2021-07-29 07:30:17.153 INFO --- [ main] c.d.driver.core.GuavaCompatibility : Detected Guava >= 19 in the classpath, using modern compatibility layer 2021-07-29 07:30:17.154 DEBUG --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NEW_NODE_DELAY_SECONDS is undefined, using default value 1 2021-07-29 07:30:17.155 DEBUG --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NOTIF_LOCK_TIMEOUT_SECONDS is undefined, using default value 60 2021-07-29 07:30:17.179 DEBUG --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true 2021-07-29 07:30:17.498 INFO --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps. 2021-07-29 07:30:17.516 DEBUG --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.NON_BLOCKING_EXECUTOR_SIZE is undefined, using default value 2 2021-07-29 07:30:17.599 DEBUG --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.242.120.196:9042] 2021-07-29 07:30:17.641 DEBUG --- [ main] i.n.u.i.logging.InternalLoggerFactory : Using SLF4J as the default logging framework 2021-07-29 07:30:17.694 DEBUG --- [ main] i.n.util.internal.PlatformDependent0 : -Dio.netty.noUnsafe: false 2021-07-29 07:30:17.694 DEBUG --- [ main] i.n.util.internal.PlatformDependent0 : Java version: 8 2021-07-29 07:30:17.700 DEBUG --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.theUnsafe: available 2021-07-29 07:30:17.701 DEBUG --- [ main] i.n.util.internal.PlatformDependent0 : sun.misc.Unsafe.copyMemory: available 2021-07-29 07:30:17.702 DEBUG --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Buffer.address: available 2021-07-29 07:30:17.703 DEBUG --- [ main] i.n.util.internal.PlatformDependent0 : direct buffer constructor: available 2021-07-29 07:30:17.705 DEBUG --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.Bits.unaligned: available, true 2021-07-29 07:30:17.705 DEBUG --- [ main] i.n.util.internal.PlatformDependent0 : jdk.internal.misc.Unsafe.allocateUninitializedArray(int): unavailable prior to Java9 2021-07-29 07:30:17.705 DEBUG --- [ main] i.n.util.internal.PlatformDependent0 : java.nio.DirectByteBuffer.(long, int): available 2021-07-29 07:30:17.705 DEBUG --- [ main] i.netty.util.internal.PlatformDependent : sun.misc.Unsafe: available 2021-07-29 07:30:17.705 DEBUG --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.tmpdir: /tmp (java.io.tmpdir) 2021-07-29 07:30:17.706 DEBUG --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.bitMode: 64 (sun.arch.data.model) 2021-07-29 07:30:17.708 DEBUG --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.noPreferDirect: false 2021-07-29 07:30:17.708 DEBUG --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.maxDirectMemory: 954728448 bytes 2021-07-29 07:30:17.708 DEBUG --- [ main] i.netty.util.internal.PlatformDependent : -Dio.netty.uninitializedArrayAllocationThreshold: -1 2021-07-29 07:30:17.709 DEBUG --- [ main] io.netty.util.internal.CleanerJava6 : java.nio.ByteBuffer.cleaner(): available 2021-07-29 07:30:17.721 DEBUG --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FORCE_NIO is undefined, using default value false 2021-07-29 07:30:17.726 DEBUG --- [ main] i.n.util.internal.NativeLibraryLoader : -Dio.netty.native.workdir: /tmp (io.netty.tmpdir) 2021-07-29 07:30:17.731 DEBUG --- [ main] i.n.util.internal.NativeLibraryLoader : Unable to load the library 'netty_transport_native_epoll_x86_64', trying other loading mechanism. java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) at java.lang.Runtime.loadLibrary0(Runtime.java:870) at java.lang.System.loadLibrary(System.java:1122) at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:263) at java.security.AccessController.doPrivileged(Native Method) at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:255) at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:233) at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:124) at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287) at io.netty.channel.epoll.Native. (Native.java:69) at io.netty.channel.epoll.Epoll. (Epoll.java:33) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at com.datastax.driver.core.NettyUtil. (NettyUtil.java:57) at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95) at com.datastax.driver.core.Connection$Factory. (Connection.java:926) at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499) at com.datastax.driver.core.Cluster.init(Cluster.java:208) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355) at com.datastax.driver.core.Cluster.connect(Cluster.java:305) at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272) at org.janusgraph.diskstorage.cql.CQLStoreManager. (CQLStoreManager.java:165) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58) at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477) at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409) at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration. (GraphDatabaseConfiguration.java:1382) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113) at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:73) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:54) at org.onap.aai.dbmap.AAIGraph$Helper. (AAIGraph.java:80) at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94) at org.onap.aai.schema.GenTester.main(GenTester.java:133) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:595) 2021-07-29 07:30:17.733 DEBUG --- [ main] i.n.util.internal.NativeLibraryLoader : netty_transport_native_epoll_x86_64 cannot be loaded from java.libary.path, now trying export to -Dio.netty.native.workdir: /tmp java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) at java.lang.Runtime.loadLibrary0(Runtime.java:870) at java.lang.System.loadLibrary(System.java:1122) at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38) at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:243) at io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:124) at io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:287) at io.netty.channel.epoll.Native. (Native.java:69) at io.netty.channel.epoll.Epoll. (Epoll.java:33) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at com.datastax.driver.core.NettyUtil. (NettyUtil.java:57) at com.datastax.driver.core.NettyOptions.eventLoopGroup(NettyOptions.java:95) at com.datastax.driver.core.Connection$Factory. (Connection.java:926) at com.datastax.driver.core.Cluster$Manager.init(Cluster.java:1499) at com.datastax.driver.core.Cluster.init(Cluster.java:208) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:376) at com.datastax.driver.core.Cluster.connectAsync(Cluster.java:355) at com.datastax.driver.core.Cluster.connect(Cluster.java:305) at org.janusgraph.diskstorage.cql.CQLStoreManager.initializeSession(CQLStoreManager.java:272) at org.janusgraph.diskstorage.cql.CQLStoreManager. (CQLStoreManager.java:165) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.janusgraph.util.system.ConfigurationUtil.instantiate(ConfigurationUtil.java:58) at org.janusgraph.diskstorage.Backend.getImplementationClass(Backend.java:477) at org.janusgraph.diskstorage.Backend.getStorageManager(Backend.java:409) at org.janusgraph.graphdb.configuration.GraphDatabaseConfiguration. (GraphDatabaseConfiguration.java:1382) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:164) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:133) at org.janusgraph.core.JanusGraphFactory.open(JanusGraphFactory.java:113) at org.onap.aai.dbmap.AAIGraph.loadGraph(AAIGraph.java:107) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:73) at org.onap.aai.dbmap.AAIGraph. (AAIGraph.java:54) at org.onap.aai.dbmap.AAIGraph$Helper. (AAIGraph.java:80) at org.onap.aai.dbmap.AAIGraph.getInstance(AAIGraph.java:94) at org.onap.aai.schema.GenTester.main(GenTester.java:133) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48) at org.springframework.boot.loader.Launcher.launch(Launcher.java:87) at org.springframework.boot.loader.Launcher.launch(Launcher.java:50) at org.springframework.boot.loader.PropertiesLauncher.main(PropertiesLauncher.java:595) Suppressed: java.lang.UnsatisfiedLinkError: no netty_transport_native_epoll_x86_64 in java.library.path at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) at java.lang.Runtime.loadLibrary0(Runtime.java:870) at java.lang.System.loadLibrary(System.java:1122) at io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:38) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at io.netty.util.internal.NativeLibraryLoader$1.run(NativeLibraryLoader.java:263) at java.security.AccessController.doPrivileged(Native Method) at io.netty.util.internal.NativeLibraryLoader.loadLibraryByHelper(NativeLibraryLoader.java:255) at io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:233) ... 41 common frames omitted 2021-07-29 07:30:17.765 DEBUG --- [ main] i.n.util.internal.NativeLibraryLoader : Successfully loaded the library /tmp/libnetty_transport_native_epoll_x86_64685082500134341110.so 2021-07-29 07:30:17.772 DEBUG --- [ main] io.netty.util.NetUtil : Loopback interface: lo (lo, 0:0:0:0:0:0:0:1%lo) 2021-07-29 07:30:17.774 DEBUG --- [ main] io.netty.util.NetUtil : /proc/sys/net/core/somaxconn: 128 2021-07-29 07:30:17.775 INFO --- [ main] com.datastax.driver.core.NettyUtil : Found Netty's native epoll transport in the classpath, using it 2021-07-29 07:30:17.830 DEBUG --- [ main] i.n.channel.MultithreadEventLoopGroup : -Dio.netty.eventLoopThreads: 4 2021-07-29 07:30:17.871 DEBUG --- [ main] i.netty.util.internal.PlatformDependent : org.jctools-core.MpscChunkedArrayQueue: available 2021-07-29 07:30:17.885 DEBUG --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.level: simple 2021-07-29 07:30:17.885 DEBUG --- [ main] io.netty.util.ResourceLeakDetector : -Dio.netty.leakDetection.targetRecords: 4 2021-07-29 07:30:17.886 DEBUG --- [ main] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@4d2f8ee7 2021-07-29 07:30:17.896 DEBUG --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.EXTENDED_PEER_CHECK is undefined, using default value true 2021-07-29 07:30:18.021 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:18.026 DEBUG --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.DISABLE_COALESCING is undefined, using default value false 2021-07-29 07:30:18.026 DEBUG --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_SCHEDULE_PERIOD_NS is undefined, using default value 10000 2021-07-29 07:30:18.026 DEBUG --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.FLUSHER_RUN_WITHOUT_WORK_TIMES is undefined, using default value 5 2021-07-29 07:30:18.039 DEBUG --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.initialSize: 1024 2021-07-29 07:30:18.040 DEBUG --- [ main] i.n.u.internal.InternalThreadLocalMap : -Dio.netty.threadLocalMap.stringBuilder.maxSize: 4096 2021-07-29 07:30:18.080 DEBUG --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numHeapArenas: 4 2021-07-29 07:30:18.080 DEBUG --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.numDirectArenas: 4 2021-07-29 07:30:18.080 DEBUG --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.pageSize: 8192 2021-07-29 07:30:18.080 DEBUG --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxOrder: 11 2021-07-29 07:30:18.080 DEBUG --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.chunkSize: 16777216 2021-07-29 07:30:18.080 DEBUG --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.tinyCacheSize: 512 2021-07-29 07:30:18.080 DEBUG --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.smallCacheSize: 256 2021-07-29 07:30:18.080 DEBUG --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.normalCacheSize: 64 2021-07-29 07:30:18.080 DEBUG --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.maxCachedBufferCapacity: 32768 2021-07-29 07:30:18.080 DEBUG --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.cacheTrimInterval: 8192 2021-07-29 07:30:18.080 DEBUG --- [ main] io.netty.buffer.PooledByteBufAllocator : -Dio.netty.allocator.useCacheForAllThreads: true 2021-07-29 07:30:18.197 DEBUG --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.allocator.type: unpooled 2021-07-29 07:30:18.197 DEBUG --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.threadLocalDirectBufferSize: 65536 2021-07-29 07:30:18.197 DEBUG --- [ main] io.netty.buffer.ByteBufUtil : -Dio.netty.maxThreadLocalCharBufferSize: 16384 2021-07-29 07:30:18.257 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:18.299 DEBUG --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxCapacity.default: 32768 2021-07-29 07:30:18.299 DEBUG --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.maxSharedCapacityFactor: 2 2021-07-29 07:30:18.299 DEBUG --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.linkCapacity: 16 2021-07-29 07:30:18.299 DEBUG --- [er-nio-worker-0] io.netty.util.Recycler : -Dio.netty.recycler.ratio: 8 2021-07-29 07:30:18.312 DEBUG --- [er-nio-worker-0] io.netty.buffer.AbstractByteBuf : -Dio.netty.buffer.bytebuf.checkAccessible: true 2021-07-29 07:30:18.312 DEBUG --- [er-nio-worker-0] i.n.util.ResourceLeakDetectorFactory : Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@1e99f434 2021-07-29 07:30:18.375 DEBUG --- [er-nio-worker-0] c.datastax.driver.core.SystemProperties : com.datastax.driver.NATIVE_TRANSPORT_MAX_FRAME_SIZE_IN_MB is undefined, using default value 256 2021-07-29 07:30:19.370 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-29 07:30:19.372 DEBUG --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map 2021-07-29 07:30:19.569 DEBUG --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema 2021-07-29 07:30:19.774 DEBUG --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdcartifact. 2021-07-29 07:30:19.792 DEBUG --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdcartifact completed in 18 milliseconds 2021-07-29 07:30:19.806 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.242.120.196:9042 2021-07-29 07:30:19.806 INFO --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor) 2021-07-29 07:30:19.808 INFO --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.242.120.196:9042 added 2021-07-29 07:30:19.809 INFO --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.179.73:9042 added 2021-07-29 07:30:19.809 INFO --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.112.75:9042 added 2021-07-29 07:30:19.814 DEBUG --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.CHECK_IO_DEADLOCKS is undefined, using default value true 2021-07-29 07:30:19.819 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 2 2021-07-29 07:30:19.822 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-2, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:19.831 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:19.831 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:19.834 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-1, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:30:19.835 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-1, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:30:19.838 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preventing new connections for the next 1000 ms 2021-07-29 07:30:19.838 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-1, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:19.841 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:19.843 DEBUG --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] marking host DOWN 2021-07-29 07:30:19.844 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-1, inFlight=0, closed=true] closing connection 2021-07-29 07:30:19.848 DEBUG --- [luster-worker-0] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-07-29 07:30:19.849 DEBUG --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] starting reconnection attempt 2021-07-29 07:30:19.851 WARN --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Error creating connection to /10.242.179.73:9042 com.datastax.driver.core.exceptions.TransportException: [/10.242.179.73:9042] Cannot connect at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:224) at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:194) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:512) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:505) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:484) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:425) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:122) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:574) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:593) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:468) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:390) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) Caused by: io.netty.channel.AbstractChannel$AnnotatedConnectException: syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042 at io.netty.channel.unix.Socket.finishConnect(..)(Unknown Source) Caused by: io.netty.channel.unix.Errors$NativeConnectException: syscall:getsockopt(..) failed: Connection refused ... 1 common frames omitted 2021-07-29 07:30:19.855 WARN --- [er-nio-worker-0] com.datastax.driver.core.Session : Error creating pool to /10.242.179.73:9042 com.datastax.driver.core.exceptions.ConnectionException: [/10.242.179.73:9042] Pool was closed during initialization at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:173) at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:158) at com.google.common.util.concurrent.Futures$6.run(Futures.java:1773) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.google.common.util.concurrent.CollectionFuture$CollectionFutureRunningState.handleAllCompleted(CollectionFuture.java:76) at com.google.common.util.concurrent.AggregateFuture$RunningState.processCompleted(AggregateFuture.java:255) at com.google.common.util.concurrent.AggregateFuture$RunningState.decrementCountAndMaybeComplete(AggregateFuture.java:242) at com.google.common.util.concurrent.AggregateFuture$RunningState.access$300(AggregateFuture.java:91) at com.google.common.util.concurrent.AggregateFuture$RunningState$1.run(AggregateFuture.java:146) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.completeWithFuture(AbstractFuture.java:730) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:666) at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:826) at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:813) at com.google.common.util.concurrent.Futures$AbstractCatchingFuture.run(Futures.java:789) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.completeWithFuture(AbstractFuture.java:730) at com.google.common.util.concurrent.AbstractFuture.setFuture(AbstractFuture.java:666) at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:826) at com.google.common.util.concurrent.Futures$AsyncCatchingFuture.doFallback(Futures.java:813) at com.google.common.util.concurrent.Futures$AbstractCatchingFuture.run(Futures.java:789) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:634) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1405) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:634) at com.google.common.util.concurrent.SettableFuture.setException(SettableFuture.java:53) at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:222) at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:194) at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:512) at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:505) at io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:484) at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:425) at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:122) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:574) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:593) at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:468) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:390) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:20.401 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-29 07:30:20.402 DEBUG --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.112.75:9042 (1 connections needed, 1 successfully opened) 2021-07-29 07:30:20.402 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for /10.242.112.75:9042 2021-07-29 07:30:20.774 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-2, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-29 07:30:20.775 DEBUG --- [er-nio-worker-2] c.d.driver.core.HostConnectionPool : Created connection pool to host cassandra/10.242.120.196:9042 (1 connections needed, 1 successfully opened) 2021-07-29 07:30:20.775 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Session : Added connection pool for cassandra/10.242.120.196:9042 2021-07-29 07:30:20.848 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:20.853 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-2, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:30:20.854 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-2, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:30:20.854 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-2, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:20.856 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-2, inFlight=0, closed=true] closing connection 2021-07-29 07:30:20.856 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:30:20.856 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-07-29 07:30:20.856 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 2000 ms 2021-07-29 07:30:21.172 DEBUG --- [ main] org.reflections.Reflections : going to scan these urls: file:/opt/app/aai-graphadmin/resources/ 2021-07-29 07:30:21.187 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/addmanualdata/README in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.188 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/scriptdata/addmanualdata/README in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.188 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.188 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/auth/aai_keystore in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.197 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.198 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/auth/realm.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.199 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.199 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/logging.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.199 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/dynamic.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.199 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/dynamic.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.200 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/datatoolscrons.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.200 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/datatoolscrons.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.201 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.201 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiEventDMaaPPublisher.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.202 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-migration.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.202 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-migration.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.202 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.202 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-realtime.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.202 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.202 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/janusgraph-cached.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.203 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.203 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/error.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.203 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.203 DEBUG --- [ main] org.reflections.Reflections : could not scan file etc/appprops/aaiconfig.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.216 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.216 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v9/aai_oxm_v9.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.217 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.217 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v14/aai_oxm_v14.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.218 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.218 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v19/aai_oxm_v19.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.234 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.234 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v15/aai_oxm_v15.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.235 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.235 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v21/aai_oxm_v21.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.258 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.258 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v17/aai_oxm_v17.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.261 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.262 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v13/aai_oxm_v13.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.288 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.289 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v8/aai_oxm_v8.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.290 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.290 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v18/aai_oxm_v18.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.291 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.291 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v11/aai_oxm_v11.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.298 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.298 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v22/aai_oxm_v22.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.312 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.313 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v23/aai_oxm_v23.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.337 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.337 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v16/aai_oxm_v16.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.346 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.347 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v20/aai_oxm_v20.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.348 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.348 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v10/aai_oxm_v10.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.374 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.374 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/oxm/v12/aai_oxm_v12.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.376 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.376 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v9/DbEdgeRules_v9.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.385 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.386 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_esr_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.386 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.387 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_hpa_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.388 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.388 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.389 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.389 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_ccvpn_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.390 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.390 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v14/DbEdgeRules_pnp_v14.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.406 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.406 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_esr_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.407 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.407 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_hpa_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.408 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.408 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.414 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.414 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_ccvpn_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.422 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.422 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_bbs_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.423 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.424 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v19/DbEdgeRules_pnp_v19.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.424 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.425 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_hpa_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.425 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.426 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.426 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.426 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_pnp_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.427 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.428 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_ccvpn_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.428 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.428 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v15/DbEdgeRules_esr_v15.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.438 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.438 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.446 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.446 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_esr_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.447 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.448 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_hpa_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.449 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.449 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_pnp_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.450 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.451 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_ccvpn_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.454 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.454 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v21/DbEdgeRules_bbs_v21.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.498 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.498 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_hpa_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.506 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.506 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_ccvpn_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.514 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.514 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_bbs_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.515 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.516 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_pnp_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.517 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.517 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_esr_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.518 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.518 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v17/DbEdgeRules_v17.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.519 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.519 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_esr_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.520 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.521 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.522 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.522 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v13/DbEdgeRules_hpa_v13.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.523 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.523 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v8/DbEdgeRules_v8.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.524 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.524 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_hpa_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.525 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.525 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_ccvpn_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.527 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.527 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_pnp_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.528 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.528 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_bbs_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.529 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.529 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_esr_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.530 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.530 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v18/DbEdgeRules_v18.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.537 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.537 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_esr_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.538 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.538 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v11/DbEdgeRules_v11.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.539 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.539 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_pnp_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.541 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.541 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_ccvpn_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.582 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.582 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.583 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.583 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_bbs_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.584 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.584 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_hpa_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.585 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.585 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v22/DbEdgeRules_esr_v22.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.585 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.586 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_ccvpn_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.586 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.586 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_hpa_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.588 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.588 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.589 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.589 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_bbs_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.589 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.589 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_pnp_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.590 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.590 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v23/DbEdgeRules_esr_v23.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.591 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.591 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_pnp_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.592 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.592 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_ccvpn_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.597 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.597 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.598 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.598 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_hpa_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.599 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.599 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_esr_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.600 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.601 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v16/DbEdgeRules_bbs_v16.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.602 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.603 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_bbs_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.604 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.604 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_ccvpn_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.604 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.604 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_hpa_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.605 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.605 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_pnp_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.607 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.607 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_esr_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.608 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.608 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v20/DbEdgeRules_v20.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.612 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.612 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v10/DbEdgeRules_v10.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.613 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.613 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_hpa_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.614 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.614 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.615 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.615 DEBUG --- [ main] org.reflections.Reflections : could not scan file schema/onap/dbedgerules/v12/DbEdgeRules_esr_v12.json in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.616 DEBUG --- [ main] org.reflections.Reflections : could not scan file dynamicPayloadGenerator-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.616 DEBUG --- [ main] org.reflections.Reflections : could not scan file dynamicPayloadGenerator-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.616 DEBUG --- [ main] org.reflections.Reflections : could not scan file forceDelete-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.617 DEBUG --- [ main] org.reflections.Reflections : could not scan file forceDelete-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.617 DEBUG --- [ main] org.reflections.Reflections : could not scan file updatePropertyTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.617 DEBUG --- [ main] org.reflections.Reflections : could not scan file updatePropertyTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.618 DEBUG --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.618 DEBUG --- [ main] org.reflections.Reflections : could not scan file localhost-access-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.619 DEBUG --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.619 DEBUG --- [ main] org.reflections.Reflections : could not scan file antlr4/org/onap/aai/AAIDsl.g4 in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.619 DEBUG --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.620 DEBUG --- [ main] org.reflections.Reflections : could not scan file logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.628 DEBUG --- [ main] org.reflections.Reflections : could not scan file org/janusgraph/graphdb/configuration/janusgraph.internal.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.628 DEBUG --- [ main] org.reflections.Reflections : could not scan file org/janusgraph/graphdb/configuration/janusgraph.internal.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.630 DEBUG --- [ main] org.reflections.Reflections : could not scan file schemaMod-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.630 DEBUG --- [ main] org.reflections.Reflections : could not scan file schemaMod-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.631 DEBUG --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.631 DEBUG --- [ main] org.reflections.Reflections : could not scan file retired.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.632 DEBUG --- [ main] org.reflections.Reflections : could not scan file dupeTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.632 DEBUG --- [ main] org.reflections.Reflections : could not scan file dupeTool-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.633 DEBUG --- [ main] org.reflections.Reflections : could not scan file migration-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.633 DEBUG --- [ main] org.reflections.Reflections : could not scan file migration-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.633 DEBUG --- [ main] org.reflections.Reflections : could not scan file uniquePropertyCheck-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.634 DEBUG --- [ main] org.reflections.Reflections : could not scan file uniquePropertyCheck-logback.xml in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.634 DEBUG --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner SubTypesScanner 2021-07-29 07:30:21.634 DEBUG --- [ main] org.reflections.Reflections : could not scan file application.properties in url file:/opt/app/aai-graphadmin/resources/ with scanner TypeAnnotationsScanner 2021-07-29 07:30:21.635 INFO --- [ main] org.reflections.Reflections : Reflections took 462 ms to scan 1 urls, producing 0 keys and 0 values 2021-07-29 07:30:21.977 DEBUG --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-2, inFlight=0, closed=true] closing connection 2021-07-29 07:30:21.977 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-2, inFlight=0, closed=true] closed, remaining = 1 2021-07-29 07:30:21.982 DEBUG --- [ main] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-1, inFlight=0, closed=true] closing connection 2021-07-29 07:30:21.982 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-1, inFlight=0, closed=true] closed, remaining = 0 2021-07-29 07:30:21.991 DEBUG --- [ main] com.datastax.driver.core.Cluster : Shutting down 2021-07-29 07:30:21.994 DEBUG --- [ main] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-1, inFlight=0, closed=true] closing connection 2021-07-29 07:30:21.994 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-1, inFlight=0, closed=true] closed, remaining = 0 2021-07-29 07:30:24.217 DEBUG --- [er-nio-worker-2] io.netty.buffer.PoolThreadCache : Freed 21 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-2 2021-07-29 07:30:24.218 DEBUG --- [er-nio-worker-0] io.netty.buffer.PoolThreadCache : Freed 28 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-0 2021-07-29 07:30:24.238 DEBUG --- [ main] c.datastax.driver.core.SystemProperties : com.datastax.driver.USE_NATIVE_CLOCK is undefined, using default value true 2021-07-29 07:30:24.238 INFO --- [ main] com.datastax.driver.core.ClockFactory : Using native clock to generate timestamps. 2021-07-29 07:30:24.238 DEBUG --- [ main] com.datastax.driver.core.Cluster : Starting new cluster with contact points [cassandra/10.242.120.196:9042] 2021-07-29 07:30:24.242 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:24.244 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:24.489 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-29 07:30:24.490 DEBUG --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing node list and token map 2021-07-29 07:30:24.508 DEBUG --- [ main] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema 2021-07-29 07:30:24.605 DEBUG --- [ main] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdcartifact. 2021-07-29 07:30:24.611 DEBUG --- [ main] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdcartifact completed in 6 milliseconds 2021-07-29 07:30:24.620 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [Control connection] established to cassandra/10.242.120.196:9042 2021-07-29 07:30:24.620 INFO --- [ main] c.d.d.c.p.DCAwareRoundRobinPolicy : Using data-center name 'Pod' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor) 2021-07-29 07:30:24.620 INFO --- [ main] com.datastax.driver.core.Cluster : New Cassandra host cassandra/10.242.120.196:9042 added 2021-07-29 07:30:24.620 INFO --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.179.73:9042 added 2021-07-29 07:30:24.620 INFO --- [ main] com.datastax.driver.core.Cluster : New Cassandra host /10.242.112.75:9042 added 2021-07-29 07:30:24.620 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 2 2021-07-29 07:30:24.621 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:24.623 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:24.625 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:24.625 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-2, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:24.627 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-1, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:24.804 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.179.73:9042, scheduling delivery 2021-07-29 07:30:24.807 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] received event DOWN 2021-07-29 07:30:24.980 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.120.196:9042-2, inFlight=0, closed=false] because: Authentication error on host cassandra/10.242.120.196:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:24.981 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preventing new connections for the next 1000 ms 2021-07-29 07:30:24.981 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-2, inFlight=0, closed=false] failed, remaining = 1 2021-07-29 07:30:24.981 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-2, inFlight=0, closed=true] closing connection 2021-07-29 07:30:24.982 WARN --- [er-nio-worker-2] com.datastax.driver.core.Session : Error creating pool to cassandra/10.242.120.196:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra/10.242.120.196:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:24.983 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-2, inFlight=0, closed=true] has already terminated 2021-07-29 07:30:25.186 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.112.75:9042-1, inFlight=0, closed=false] because: Authentication error on host /10.242.112.75:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:25.187 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preventing new connections for the next 1000 ms 2021-07-29 07:30:25.187 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-1, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:25.188 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-1, inFlight=0, closed=true] closing connection 2021-07-29 07:30:25.188 DEBUG --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] marking host DOWN 2021-07-29 07:30:25.188 DEBUG --- [luster-worker-0] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-07-29 07:30:25.188 DEBUG --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] starting reconnection attempt 2021-07-29 07:30:25.189 WARN --- [er-nio-worker-2] com.datastax.driver.core.Session : Error creating pool to /10.242.112.75:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.112.75:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:25.189 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-1, inFlight=0, closed=true] has already terminated 2021-07-29 07:30:25.237 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-1, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-29 07:30:25.238 DEBUG --- [er-nio-worker-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.179.73:9042 (1 connections needed, 1 successfully opened) 2021-07-29 07:30:25.238 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Session : Added connection pool for /10.242.179.73:9042 2021-07-29 07:30:25.238 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 2 2021-07-29 07:30:25.239 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-3, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:25.581 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.120.196:9042-3, inFlight=0, closed=false] because: Authentication error on host cassandra/10.242.120.196:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:25.583 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preventing new connections for the next 1000 ms 2021-07-29 07:30:25.583 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-3, inFlight=0, closed=false] failed, remaining = 1 2021-07-29 07:30:25.583 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-3, inFlight=0, closed=true] closing connection 2021-07-29 07:30:25.584 WARN --- [er-nio-worker-0] com.datastax.driver.core.Session : Error creating pool to cassandra/10.242.120.196:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra/10.242.120.196:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:25.584 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-3, inFlight=0, closed=true] has already terminated 2021-07-29 07:30:25.809 DEBUG --- [d-task-worker-0] com.datastax.driver.core.Cluster : Ignoring down event on /10.242.179.73:9042 because it still has active connections 2021-07-29 07:30:26.188 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:26.193 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-2, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:26.391 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is query.fast-propertyValue is true 2021-07-29 07:30:26.391 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is query.smart-limitValue is false 2021-07-29 07:30:26.391 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is storage.backendValue is cql 2021-07-29 07:30:26.391 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is storage.hostnameValue is cassandra 2021-07-29 07:30:26.391 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is storage.cql.keyspaceValue is aaigraph 2021-07-29 07:30:26.391 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is storage.usernameValue is cassandra 2021-07-29 07:30:26.391 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is storage.passwordValue is cassandra 2021-07-29 07:30:26.391 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is storage.cql.read-consistency-levelValue is LOCAL_QUORUM 2021-07-29 07:30:26.391 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is storage.cql.write-consistency-levelValue is LOCAL_QUORUM 2021-07-29 07:30:26.392 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is storage.cql.replication-factorValue is 3 2021-07-29 07:30:26.392 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is storage.cql.only-use-local-consistency-for-system-operationsValue is true 2021-07-29 07:30:26.392 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is storage.lock.wait-timeValue is 300 2021-07-29 07:30:26.392 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is cache.db-cacheValue is false 2021-07-29 07:30:26.392 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is load.snapshot.fileValue is false 2021-07-29 07:30:26.392 INFO --- [ main] org.onap.aai.util.GraphAdminDBUtils : Key is graph.unique-instance-idValue is 27_dev-aai-graphadmin-create-db-schema-8lq66_GenTester_realtime_1627543816746 -- Loading new schema elements into JanusGraph -- 2021-07-29 07:30:26.449 INFO --- [ main] org.onap.aai.util.AAIConfig : Initializing AAIConfig 2021-07-29 07:30:26.449 DEBUG --- [ main] org.onap.aai.util.AAIConfig : Reloading config from /opt/app/aai-graphadmin/resources/etc/appprops/aaiconfig.properties 2021-07-29 07:30:26.449 INFO --- [ main] org.onap.aai.util.AAIConfig : Found the aaiconfig.properties in the following location: /opt/app/aai-graphadmin/resources/etc/appprops/aaiconfig.properties 2021-07-29 07:30:26.450 INFO --- [ main] org.onap.aai.util.AAIConfig : A&AI Server Node Name = aai.config.nodename 2021-07-29 07:30:26.886 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.112.75:9042-2, inFlight=0, closed=false] because: Authentication error on host /10.242.112.75:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:26.887 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-2, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:26.887 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-2, inFlight=0, closed=true] closing connection 2021-07-29 07:30:26.887 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.112.75:9042 2021-07-29 07:30:26.887 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-2, inFlight=0, closed=true] has already terminated 2021-07-29 07:30:26.894 ERROR --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.112.75:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:26.895 ERROR --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.112.75:9042, scheduling retry in 2000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.112.75:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:26.896 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] next reconnection attempt in 2000 ms 2021-07-29 07:30:28.803 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-1, inFlight=1, closed=false] connection error io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer at io.netty.channel.unix.FileDescriptor.readAddress(..)(Unknown Source) 2021-07-29 07:30:28.804 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-1, inFlight=1, closed=false] because: [/10.242.179.73:9042] Unexpected exception triggered (io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer) 2021-07-29 07:30:28.804 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preventing new connections for the next 1000 ms 2021-07-29 07:30:28.804 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-1, inFlight=1, closed=false] failed, remaining = 0 2021-07-29 07:30:28.804 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-1, inFlight=1, closed=true] closing connection 2021-07-29 07:30:28.804 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Not terminating Connection[/10.242.179.73:9042-1, inFlight=1, closed=true]: there are still pending requests 2021-07-29 07:30:28.804 DEBUG --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] marking host DOWN 2021-07-29 07:30:28.805 DEBUG --- [luster-worker-0] com.datastax.driver.core.RequestHandler : onException triggered but the response was completed by another thread, cancelling (retryCount = 0, queryState = QueryState(count=0, inProgress=false, cancelled=false), queryStateRef = QueryState(count=0, inProgress=false, cancelled=false)) 2021-07-29 07:30:28.806 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [797549833-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@972a55b at consistency LOCAL_QUORUM 2021-07-29 07:30:28.807 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.RequestHandler : [797549833-0] Error querying /10.242.179.73:9042 : com.datastax.driver.core.exceptions.TransportException: [/10.242.179.73:9042] Connection has been closed 2021-07-29 07:30:28.808 DEBUG --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 2 2021-07-29 07:30:28.813 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-4, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:28.835 ERROR --- [raphID(0)(4)[0]] com.datastax.driver.core.RequestHandler : Unexpected error while querying cassandra/10.242.120.196 com.datastax.driver.core.exceptions.ConnectionException: [cassandra/10.242.120.196:9042] Pool is INITIALIZING at com.datastax.driver.core.HostConnectionPool.borrowConnection(HostConnectionPool.java:241) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.query(RequestHandler.java:378) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:341) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLStoreManager.lambda$null$28(CQLStoreManager.java:469) at io.vavr.collection.Iterator$35.getNext(Iterator.java:1632) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Traversable.foldLeft(Traversable.java:471) at io.vavr.concurrent.Future.sequence(Future.java:549) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:451) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:28.836 DEBUG --- [raphID(0)(4)[0]] com.datastax.driver.core.RequestHandler : [188807545-0] Error querying cassandra/10.242.120.196:9042 : com.datastax.driver.core.exceptions.ConnectionException: [cassandra/10.242.120.196:9042] Pool is INITIALIZING 2021-07-29 07:30:28.839 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Storage exception while deleting old block application - retrying in PT0.2S org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:478) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.120.196:9042 (com.datastax.driver.core.exceptions.ConnectionException: [cassandra/10.242.120.196:9042] Pool is INITIALIZING)) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.120.196:9042 (com.datastax.driver.core.exceptions.ConnectionException: [cassandra/10.242.120.196:9042] Pool is INITIALIZING)) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution$1.onFailure(RequestHandler.java:426) at com.google.common.util.concurrent.Futures$6.run(Futures.java:1764) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.Futures$ImmediateFuture.addListener(Futures.java:153) at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1776) at com.datastax.driver.core.GuavaCompatibility.addCallback(GuavaCompatibility.java:112) at com.datastax.driver.core.GuavaCompatibility.addCallback(GuavaCompatibility.java:100) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.query(RequestHandler.java:382) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:341) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLStoreManager.lambda$null$28(CQLStoreManager.java:469) at io.vavr.collection.Iterator$35.getNext(Iterator.java:1632) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Traversable.foldLeft(Traversable.java:471) at io.vavr.concurrent.Future.sequence(Future.java:549) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:451) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:30:28.897 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:28.900 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-3, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:28.904 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.112.75:9042-3, inFlight=0, closed=false] because: Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:28.904 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-3, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:28.904 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-3, inFlight=0, closed=true] closing connection 2021-07-29 07:30:28.904 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.112.75:9042 2021-07-29 07:30:28.904 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-3, inFlight=0, closed=true] has already terminated 2021-07-29 07:30:28.904 ERROR --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:28.905 ERROR --- [-reconnection-0] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.112.75:9042, scheduling retry in 4000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:28.906 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] next reconnection attempt in 4000 ms 2021-07-29 07:30:29.042 ERROR --- [raphID(0)(4)[0]] com.datastax.driver.core.RequestHandler : Unexpected error while querying cassandra/10.242.120.196 com.datastax.driver.core.exceptions.ConnectionException: [cassandra/10.242.120.196:9042] Pool is INITIALIZING at com.datastax.driver.core.HostConnectionPool.borrowConnection(HostConnectionPool.java:241) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.query(RequestHandler.java:378) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:341) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLStoreManager.lambda$null$28(CQLStoreManager.java:469) at io.vavr.collection.Iterator$35.getNext(Iterator.java:1632) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Traversable.foldLeft(Traversable.java:471) at io.vavr.concurrent.Future.sequence(Future.java:549) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:451) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:29.042 DEBUG --- [raphID(0)(4)[0]] com.datastax.driver.core.RequestHandler : [1883835519-0] Error querying cassandra/10.242.120.196:9042 : com.datastax.driver.core.exceptions.ConnectionException: [cassandra/10.242.120.196:9042] Pool is INITIALIZING 2021-07-29 07:30:29.044 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Storage exception while deleting old block application - retrying in PT0.2S org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:478) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.120.196:9042 (com.datastax.driver.core.exceptions.ConnectionException: [cassandra/10.242.120.196:9042] Pool is INITIALIZING)) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: cassandra/10.242.120.196:9042 (com.datastax.driver.core.exceptions.ConnectionException: [cassandra/10.242.120.196:9042] Pool is INITIALIZING)) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution$1.onFailure(RequestHandler.java:426) at com.google.common.util.concurrent.Futures$6.run(Futures.java:1764) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.Futures$ImmediateFuture.addListener(Futures.java:153) at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1776) at com.datastax.driver.core.GuavaCompatibility.addCallback(GuavaCompatibility.java:112) at com.datastax.driver.core.GuavaCompatibility.addCallback(GuavaCompatibility.java:100) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.query(RequestHandler.java:382) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:341) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLStoreManager.lambda$null$28(CQLStoreManager.java:469) at io.vavr.collection.Iterator$35.getNext(Iterator.java:1632) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Traversable.foldLeft(Traversable.java:471) at io.vavr.concurrent.Future.sequence(Future.java:549) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:451) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:30:29.172 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.120.196:9042-4, inFlight=0, closed=false] because: Authentication error on host cassandra/10.242.120.196:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:29.172 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preventing new connections for the next 1000 ms 2021-07-29 07:30:29.172 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-4, inFlight=0, closed=false] failed, remaining = 1 2021-07-29 07:30:29.172 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-4, inFlight=0, closed=true] closing connection 2021-07-29 07:30:29.173 WARN --- [er-nio-worker-3] com.datastax.driver.core.Session : Error creating pool to cassandra/10.242.120.196:9042 com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host cassandra/10.242.120.196:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:29.174 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-4, inFlight=0, closed=true] has already terminated 2021-07-29 07:30:29.174 DEBUG --- [luster-worker-0] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-07-29 07:30:29.174 DEBUG --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] starting reconnection attempt 2021-07-29 07:30:29.249 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Storage exception while deleting old block application - retrying in PT0.2S org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:478) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLStoreManager.lambda$null$28(CQLStoreManager.java:469) at io.vavr.collection.Iterator$35.getNext(Iterator.java:1632) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Traversable.foldLeft(Traversable.java:471) at io.vavr.concurrent.Future.sequence(Future.java:549) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:451) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:30:29.453 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Storage exception while deleting old block application - retrying in PT0.2S org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:478) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLStoreManager.lambda$null$28(CQLStoreManager.java:469) at io.vavr.collection.Iterator$35.getNext(Iterator.java:1632) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Traversable.foldLeft(Traversable.java:471) at io.vavr.concurrent.Future.sequence(Future.java:549) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:451) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:30:29.657 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Storage exception while deleting old block application - retrying in PT0.2S org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:478) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLStoreManager.lambda$null$28(CQLStoreManager.java:469) at io.vavr.collection.Iterator$35.getNext(Iterator.java:1632) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Iterator$34.getNext(Iterator.java:1510) at io.vavr.collection.AbstractIterator.next(AbstractIterator.java:34) at io.vavr.collection.Traversable.foldLeft(Traversable.java:471) at io.vavr.concurrent.Future.sequence(Future.java:549) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateManyUnlogged(CQLStoreManager.java:451) at org.janusgraph.diskstorage.cql.CQLStoreManager.mutateMany(CQLStoreManager.java:409) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.mutate(CQLKeyColumnValueStore.java:364) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:329) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$4.call(ConsistentKeyIDAuthority.java:326) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:326) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:30:29.862 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT0.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$3.call(ConsistentKeyIDAuthority.java:293) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$3.call(ConsistentKeyIDAuthority.java:290) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:290) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.179.73:9042 (com.datastax.driver.core.exceptions.TransportException: [/10.242.179.73:9042] Connection has been closed)) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.179.73:9042 (com.datastax.driver.core.exceptions.TransportException: [/10.242.179.73:9042] Connection has been closed)) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onException(RequestHandler.java:922) at com.datastax.driver.core.Connection$Dispatcher.errorOutAllHandler(Connection.java:1311) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1397) at com.datastax.driver.core.Connection$ConnectionCloseFuture.force(Connection.java:1378) at com.datastax.driver.core.Connection.defunct(Connection.java:570) at com.datastax.driver.core.Connection$Dispatcher.exceptionCaught(Connection.java:1301) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:280) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:259) at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:251) at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:280) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:259) at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:251) at io.netty.channel.ChannelHandlerAdapter.exceptionCaught(ChannelHandlerAdapter.java:88) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:280) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:259) at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:251) at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:280) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:259) at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:251) at io.netty.channel.ChannelHandlerAdapter.exceptionCaught(ChannelHandlerAdapter.java:88) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:280) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:259) at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:251) at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:280) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:259) at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:251) at io.netty.channel.ChannelHandlerAdapter.exceptionCaught(ChannelHandlerAdapter.java:88) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:280) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:259) at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:251) at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:131) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:280) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:259) at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:251) at io.netty.channel.DefaultChannelPipeline$HeadContext.exceptionCaught(DefaultChannelPipeline.java:1271) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:280) at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:259) at io.netty.channel.DefaultChannelPipeline.fireExceptionCaught(DefaultChannelPipeline.java:909) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.handleReadException(AbstractEpollStreamChannel.java:655) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:773) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-29 07:30:30.174 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:30.176 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-2, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:30:30.177 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-2, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:30:30.177 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-2, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:30.177 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:30:30.177 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-2, inFlight=0, closed=true] closing connection 2021-07-29 07:30:30.177 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-07-29 07:30:30.177 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 2000 ms 2021-07-29 07:30:30.466 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT1.2S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:30:31.671 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT2.4S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:30:32.178 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:32.180 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE sdcartifact.sdcschemafiles, scheduling delivery 2021-07-29 07:30:32.180 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-3, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:30:32.181 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-3, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:30:32.181 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-3, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:32.181 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-3, inFlight=0, closed=true] closing connection 2021-07-29 07:30:32.182 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 4000 milliseconds 2021-07-29 07:30:32.182 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 4000 ms 2021-07-29 07:30:32.182 DEBUG --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:30:32.906 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:32.909 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-4, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:32.979 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.112.75:9042-4, inFlight=0, closed=false] because: Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:32.979 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-4, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:32.979 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.112.75:9042 2021-07-29 07:30:32.980 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-4, inFlight=0, closed=true] closing connection 2021-07-29 07:30:32.980 ERROR --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:32.981 ERROR --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.112.75:9042, scheduling retry in 8000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:32.981 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] next reconnection attempt in 8000 ms 2021-07-29 07:30:32.981 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-4, inFlight=0, closed=true] has already terminated 2021-07-29 07:30:33.185 DEBUG --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcartifact.sdcschemafiles (TABLE) 2021-07-29 07:30:33.274 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED KEYSPACE sdcrepository, scheduling delivery 2021-07-29 07:30:34.074 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT4.8S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:30:34.274 DEBUG --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcrepository 2021-07-29 07:30:34.287 DEBUG --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdcartifact. 2021-07-29 07:30:34.294 DEBUG --- [luster-worker-1] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdcartifact completed in 7 milliseconds 2021-07-29 07:30:35.071 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE sdcrepository.migrationtasks, scheduling delivery 2021-07-29 07:30:35.479 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:30:26.386Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ... 3 common frames omitted 2021-07-29 07:30:36.072 DEBUG --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcrepository.migrationtasks (TABLE) 2021-07-29 07:30:36.182 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:36.185 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-4, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:30:36.185 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-4, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:30:36.185 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-4, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:36.186 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-4, inFlight=0, closed=true] closing connection 2021-07-29 07:30:36.186 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:30:36.186 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 8000 milliseconds 2021-07-29 07:30:36.186 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 8000 ms 2021-07-29 07:30:36.889 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE sdcrepository.operationalenvironment, scheduling delivery 2021-07-29 07:30:37.889 DEBUG --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcrepository.operationalenvironment (TABLE) 2021-07-29 07:30:38.879 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT9.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:30:39.180 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE sdcrepository.operationalenvironment, scheduling delivery 2021-07-29 07:30:40.180 DEBUG --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcrepository.operationalenvironment (TABLE) 2021-07-29 07:30:40.981 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:40.983 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-5, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:40.987 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.112.75:9042-5, inFlight=0, closed=false] because: Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:40.987 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-5, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:40.988 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-5, inFlight=0, closed=true] closing connection 2021-07-29 07:30:40.988 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.112.75:9042 2021-07-29 07:30:40.988 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-5, inFlight=0, closed=true] has already terminated 2021-07-29 07:30:40.988 ERROR --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:40.989 ERROR --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.112.75:9042, scheduling retry in 16000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:40.990 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] next reconnection attempt in 16000 ms 2021-07-29 07:30:41.984 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE sdcrepository.featuretogglestate, scheduling delivery 2021-07-29 07:30:42.772 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED KEYSPACE sdcaudit, scheduling delivery 2021-07-29 07:30:43.773 DEBUG --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for everything.null (null) 2021-07-29 07:30:43.897 DEBUG --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Computing token to replica map for keyspace: sdcartifact. 2021-07-29 07:30:43.903 DEBUG --- [luster-worker-0] licationStrategy$NetworkTopologyStrategy : Token to replica map computation for keyspace sdcartifact completed in 6 milliseconds 2021-07-29 07:30:43.984 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:30:26.386Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ... 3 common frames omitted 2021-07-29 07:30:44.187 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:44.189 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-5, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:30:44.190 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-5, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:30:44.190 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-5, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:44.190 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-5, inFlight=0, closed=true] closing connection 2021-07-29 07:30:44.190 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:30:44.190 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 16000 milliseconds 2021-07-29 07:30:44.191 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 16000 ms 2021-07-29 07:30:44.573 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE sdcaudit.useradminevent, scheduling delivery 2021-07-29 07:30:45.573 DEBUG --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcaudit.useradminevent (TABLE) 2021-07-29 07:30:46.873 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE sdcaudit.useradminevent, scheduling delivery 2021-07-29 07:30:47.873 DEBUG --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcaudit.useradminevent (TABLE) 2021-07-29 07:30:48.483 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT9.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:30:49.075 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE sdcaudit.useraccessevent, scheduling delivery 2021-07-29 07:30:50.075 DEBUG --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcaudit.useraccessevent (TABLE) 2021-07-29 07:30:51.770 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE sdcaudit.useraccessevent, scheduling delivery 2021-07-29 07:30:52.181 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:30:26.386Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ... 3 common frames omitted 2021-07-29 07:30:52.771 DEBUG --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcaudit.useraccessevent (TABLE) 2021-07-29 07:30:53.773 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT CREATED TABLE sdcaudit.resourceadminevent, scheduling delivery 2021-07-29 07:30:54.239 DEBUG --- [ection-reaper-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-1, inFlight=0, closed=true] has already terminated 2021-07-29 07:30:54.773 DEBUG --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcaudit.resourceadminevent (TABLE) 2021-07-29 07:30:56.971 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE sdcaudit.resourceadminevent, scheduling delivery 2021-07-29 07:30:56.990 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:30:56.992 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-6, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:30:57.081 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.112.75:9042-6, inFlight=0, closed=false] because: Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:57.081 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-6, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:30:57.081 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-6, inFlight=0, closed=true] closing connection 2021-07-29 07:30:57.081 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.112.75:9042 2021-07-29 07:30:57.081 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-6, inFlight=0, closed=true] has already terminated 2021-07-29 07:30:57.082 ERROR --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:30:57.082 ERROR --- [-reconnection-1] com.datastax.driver.core.Cluster : Authentication error during reconnection to /10.242.112.75:9042, scheduling retry in 32000 milliseconds com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM at com.datastax.driver.core.Connection$8.apply(Connection.java:503) at com.datastax.driver.core.Connection$8.apply(Connection.java:465) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1442) at com.google.common.util.concurrent.Futures$AsyncChainingFuture.doTransform(Futures.java:1433) at com.google.common.util.concurrent.Futures$AbstractChainingFuture.run(Futures.java:1408) at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:817) at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:753) at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:613) at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:30:57.083 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] next reconnection attempt in 32000 ms 2021-07-29 07:30:57.972 DEBUG --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcaudit.resourceadminevent (TABLE) 2021-07-29 07:30:58.085 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT9.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:31:00.128 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:30:26.386Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ... 3 common frames omitted 2021-07-29 07:31:00.191 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:00.193 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-6, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:31:00.194 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-6, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:31:00.194 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-6, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:00.194 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-6, inFlight=0, closed=true] closing connection 2021-07-29 07:31:00.194 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:31:00.194 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 32000 milliseconds 2021-07-29 07:31:00.194 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 32000 ms 2021-07-29 07:31:00.769 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE sdcaudit.resourceadminevent, scheduling delivery 2021-07-29 07:31:01.769 DEBUG --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcaudit.resourceadminevent (TABLE) 2021-07-29 07:31:02.769 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE sdcaudit.resourceadminevent, scheduling delivery 2021-07-29 07:31:03.769 DEBUG --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcaudit.resourceadminevent (TABLE) 2021-07-29 07:31:04.888 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT UPDATED TABLE sdcaudit.resourceadminevent, scheduling delivery 2021-07-29 07:31:05.684 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Cluster : Received event EVENT DOWN /10.242.120.196:9042, scheduling delivery 2021-07-29 07:31:05.684 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.120.196:9042] received event DOWN 2021-07-29 07:31:05.686 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-1, inFlight=0, closed=false] connection error io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer at io.netty.channel.unix.FileDescriptor.readAddress(..)(Unknown Source) 2021-07-29 07:31:05.686 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.120.196:9042-1, inFlight=0, closed=false] because: [cassandra/10.242.120.196:9042] Unexpected exception triggered (io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer) 2021-07-29 07:31:05.686 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preventing new connections for the next 2000 ms 2021-07-29 07:31:05.686 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-1, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:05.686 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-1, inFlight=0, closed=true] closing connection 2021-07-29 07:31:05.686 DEBUG --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] marking host DOWN 2021-07-29 07:31:05.687 DEBUG --- [luster-worker-0] c.d.driver.core.ControlConnection : [Control connection] cassandra/10.242.120.196:9042 is down/removed and it was the control host, triggering reconnect 2021-07-29 07:31:05.689 DEBUG --- [luster-worker-0] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 0ms 2021-07-29 07:31:05.689 DEBUG --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [Control connection] starting reconnection attempt 2021-07-29 07:31:05.690 DEBUG --- [luster-worker-0] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-07-29 07:31:05.690 DEBUG --- [luster-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] starting reconnection attempt 2021-07-29 07:31:05.690 ERROR --- [-reconnection-1] c.d.driver.core.ControlConnection : [Control connection] Cannot connect to any host, scheduling retry in 1000 milliseconds 2021-07-29 07:31:05.690 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 1000 ms 2021-07-29 07:31:05.889 DEBUG --- [luster-worker-1] c.d.driver.core.ControlConnection : [Control connection] Refreshing schema for sdcaudit.resourceadminevent (TABLE) 2021-07-29 07:31:06.685 DEBUG --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.120.196:9042 2021-07-29 07:31:06.690 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:06.691 ERROR --- [-reconnection-1] c.d.driver.core.ControlConnection : [Control connection] Cannot connect to any host, scheduling retry in 2000 milliseconds 2021-07-29 07:31:06.691 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 2000 ms 2021-07-29 07:31:06.692 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-5, inFlight=0, closed=false] Error connecting to cassandra/10.242.120.196:9042 (syscall:getsockopt(..) failed: Connection refused: cassandra/10.242.120.196:9042) 2021-07-29 07:31:06.693 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.120.196:9042-5, inFlight=0, closed=false] because: [cassandra/10.242.120.196:9042] Cannot connect 2021-07-29 07:31:06.693 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-5, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:06.693 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.120.196:9042 2021-07-29 07:31:06.693 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-5, inFlight=0, closed=true] closing connection 2021-07-29 07:31:06.694 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.242.120.196:9042 ([cassandra/10.242.120.196:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-07-29 07:31:06.694 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] next reconnection attempt in 2000 ms 2021-07-29 07:31:07.689 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT9.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:31:08.692 ERROR --- [-reconnection-1] c.d.driver.core.ControlConnection : [Control connection] Cannot connect to any host, scheduling retry in 4000 milliseconds 2021-07-29 07:31:08.692 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 4000 ms 2021-07-29 07:31:08.694 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:08.697 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-6, inFlight=0, closed=false] Error connecting to cassandra/10.242.120.196:9042 (syscall:getsockopt(..) failed: Connection refused: cassandra/10.242.120.196:9042) 2021-07-29 07:31:08.697 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.120.196:9042-6, inFlight=0, closed=false] because: [cassandra/10.242.120.196:9042] Cannot connect 2021-07-29 07:31:08.697 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-6, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:08.697 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-6, inFlight=0, closed=true] closing connection 2021-07-29 07:31:08.697 DEBUG --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.120.196:9042 2021-07-29 07:31:08.698 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.242.120.196:9042 ([cassandra/10.242.120.196:9042] Cannot connect), scheduling retry in 4000 milliseconds 2021-07-29 07:31:08.698 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] next reconnection attempt in 4000 ms 2021-07-29 07:31:09.035 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:30:26.386Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ... 3 common frames omitted 2021-07-29 07:31:12.693 ERROR --- [-reconnection-1] c.d.driver.core.ControlConnection : [Control connection] Cannot connect to any host, scheduling retry in 8000 milliseconds 2021-07-29 07:31:12.694 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 8000 ms 2021-07-29 07:31:12.698 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:12.701 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-7, inFlight=0, closed=false] Error connecting to cassandra/10.242.120.196:9042 (syscall:getsockopt(..) failed: Connection refused: cassandra/10.242.120.196:9042) 2021-07-29 07:31:12.701 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.120.196:9042-7, inFlight=0, closed=false] because: [cassandra/10.242.120.196:9042] Cannot connect 2021-07-29 07:31:12.701 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-7, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:12.702 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-7, inFlight=0, closed=true] closing connection 2021-07-29 07:31:12.702 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.120.196:9042 2021-07-29 07:31:12.702 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.242.120.196:9042 ([cassandra/10.242.120.196:9042] Cannot connect), scheduling retry in 8000 milliseconds 2021-07-29 07:31:12.702 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] next reconnection attempt in 8000 ms 2021-07-29 07:31:17.007 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:30:26.386Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ... 3 common frames omitted 2021-07-29 07:31:17.293 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT9.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:31:20.694 ERROR --- [-reconnection-1] c.d.driver.core.ControlConnection : [Control connection] Cannot connect to any host, scheduling retry in 16000 milliseconds 2021-07-29 07:31:20.695 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 16000 ms 2021-07-29 07:31:20.703 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:20.704 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-8, inFlight=0, closed=false] Error connecting to cassandra/10.242.120.196:9042 (syscall:getsockopt(..) failed: Connection refused: cassandra/10.242.120.196:9042) 2021-07-29 07:31:20.705 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.120.196:9042-8, inFlight=0, closed=false] because: [cassandra/10.242.120.196:9042] Cannot connect 2021-07-29 07:31:20.705 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-8, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:20.705 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-8, inFlight=0, closed=true] closing connection 2021-07-29 07:31:20.705 DEBUG --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.120.196:9042 2021-07-29 07:31:20.705 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.242.120.196:9042 ([cassandra/10.242.120.196:9042] Cannot connect), scheduling retry in 16000 milliseconds 2021-07-29 07:31:20.705 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] next reconnection attempt in 16000 ms 2021-07-29 07:31:24.575 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:30:26.386Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) ... 3 common frames omitted 2021-07-29 07:31:26.897 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT9.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:435) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (no host was tried) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler.startNewExecution(RequestHandler.java:138) at com.datastax.driver.core.RequestHandler.sendRequest(RequestHandler.java:120) at com.datastax.driver.core.SessionManager.execute(SessionManager.java:700) at com.datastax.driver.core.SessionManager.executeAsync(SessionManager.java:144) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:282) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) ... 4 common frames omitted 2021-07-29 07:31:29.083 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:29.085 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-7, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:31:29.979 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-7, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-29 07:31:29.979 DEBUG --- [-reconnection-1] com.datastax.driver.core.Cluster : Successful reconnection to /10.242.112.75:9042, setting host UP 2021-07-29 07:31:29.979 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] marking host UP 2021-07-29 07:31:29.979 DEBUG --- [-reconnection-1] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP 2021-07-29 07:31:29.980 DEBUG --- [-reconnection-1] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.112.75:9042 2021-07-29 07:31:30.282 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preparing to open 0 new connections, total = 1 2021-07-29 07:31:30.282 DEBUG --- [-reconnection-1] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.112.75:9042 (1 connections needed, 1 successfully opened) 2021-07-29 07:31:30.284 DEBUG --- [-reconnection-1] com.datastax.driver.core.Session : Added connection pool for /10.242.112.75:9042 2021-07-29 07:31:30.286 DEBUG --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future 2021-07-29 07:31:32.195 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:32.197 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-7, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:31:34.287 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-7, inFlight=0, closed=false] Transport initialized, connection ready 2021-07-29 07:31:34.288 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Successful reconnection to /10.242.179.73:9042, setting host UP 2021-07-29 07:31:34.288 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] marking host UP 2021-07-29 07:31:34.288 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Cancelling reconnection attempt since node is UP 2021-07-29 07:31:34.288 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Preparing 54 prepared queries on newly up node /10.242.179.73:9042 2021-07-29 07:31:34.803 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 0 new connections, total = 1 2021-07-29 07:31:34.804 DEBUG --- [-reconnection-0] c.d.driver.core.HostConnectionPool : Created connection pool to host /10.242.179.73:9042 (1 connections needed, 1 successfully opened) 2021-07-29 07:31:34.804 DEBUG --- [-reconnection-0] com.datastax.driver.core.Session : Added connection pool for /10.242.179.73:9042 2021-07-29 07:31:34.804 DEBUG --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Reconnection successful, cleared the future 2021-07-29 07:31:34.990 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-7, inFlight=0, closed=false] connection error io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer at io.netty.channel.unix.FileDescriptor.readAddress(..)(Unknown Source) 2021-07-29 07:31:34.991 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-7, inFlight=0, closed=false] because: [/10.242.179.73:9042] Unexpected exception triggered (io.netty.channel.unix.Errors$NativeIoException: syscall:read(..) failed: Connection reset by peer) 2021-07-29 07:31:34.991 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preventing new connections for the next 1000 ms 2021-07-29 07:31:34.991 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-7, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:34.991 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-7, inFlight=0, closed=true] closing connection 2021-07-29 07:31:34.991 DEBUG --- [luster-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] marking host DOWN 2021-07-29 07:31:34.991 DEBUG --- [luster-worker-1] c.d.d.core.AbstractReconnectionHandler : First reconnection scheduled in 1000ms 2021-07-29 07:31:34.991 DEBUG --- [luster-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] starting reconnection attempt 2021-07-29 07:31:35.992 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:35.994 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-8, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:31:35.994 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-8, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:31:35.994 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-8, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:35.994 DEBUG --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:31:35.994 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-8, inFlight=0, closed=true] closing connection 2021-07-29 07:31:35.995 DEBUG --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 2000 milliseconds 2021-07-29 07:31:35.995 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 2000 ms 2021-07-29 07:31:36.695 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preparing to open 1 new connections, total = 2 2021-07-29 07:31:36.697 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-8, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:31:36.705 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:36.707 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-9, inFlight=0, closed=false] Error connecting to cassandra/10.242.120.196:9042 (syscall:getsockopt(..) failed: Connection refused: cassandra/10.242.120.196:9042) 2021-07-29 07:31:36.708 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.120.196:9042-9, inFlight=0, closed=false] because: [cassandra/10.242.120.196:9042] Cannot connect 2021-07-29 07:31:36.708 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-9, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:36.708 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-9, inFlight=0, closed=true] closing connection 2021-07-29 07:31:36.708 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.120.196:9042 2021-07-29 07:31:36.708 DEBUG --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.242.120.196:9042 ([cassandra/10.242.120.196:9042] Cannot connect), scheduling retry in 32000 milliseconds 2021-07-29 07:31:36.708 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] next reconnection attempt in 32000 ms 2021-07-29 07:31:36.988 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT9.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Wrote claim for id block [1451, 1501) in PT0.387S => too slow, threshold is: PT0.3S at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:276) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-07-29 07:31:37.995 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:37.998 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-9, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:31:37.998 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-9, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:31:37.998 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-9, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:37.999 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-9, inFlight=0, closed=true] closing connection 2021-07-29 07:31:37.999 DEBUG --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:31:37.999 DEBUG --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 4000 milliseconds 2021-07-29 07:31:37.999 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 4000 ms 2021-07-29 07:31:42.000 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:42.001 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-10, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:31:42.002 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-10, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:31:42.002 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-10, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:42.002 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:31:42.002 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-10, inFlight=0, closed=true] closing connection 2021-07-29 07:31:42.003 DEBUG --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 8000 milliseconds 2021-07-29 07:31:42.003 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 8000 ms 2021-07-29 07:31:42.486 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.112.75:9042-8, inFlight=0, closed=false] because: Authentication error on host /10.242.112.75:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-07-29 07:31:42.486 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preventing new connections for the next 1000 ms 2021-07-29 07:31:42.487 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-8, inFlight=0, closed=false] failed, remaining = 1 2021-07-29 07:31:42.487 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-8, inFlight=0, closed=true] closing connection 2021-07-29 07:31:42.487 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-8, inFlight=0, closed=true] has already terminated 2021-07-29 07:31:42.487 ERROR --- [-reconnection-0] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.112.75:9042: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses. 2021-07-29 07:31:42.487 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 32000 ms 2021-07-29 07:31:45.800 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:31:35.281Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 23 common frames omitted 2021-07-29 07:31:50.004 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:31:50.006 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-11, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:31:50.006 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-11, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:31:50.006 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-11, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:31:50.006 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-11, inFlight=0, closed=true] closing connection 2021-07-29 07:31:50.006 DEBUG --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:31:50.006 DEBUG --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 16000 milliseconds 2021-07-29 07:31:50.006 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 16000 ms 2021-07-29 07:31:51.595 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT9.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 23 common frames omitted 2021-07-29 07:31:55.881 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:31:35.281Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.exceptions.ReadTimeoutException.copy(ReadTimeoutException.java:124) at com.datastax.driver.core.Responses$Error.asException(Responses.java:169) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:627) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency LOCAL_QUORUM (2 responses were required but only 1 replica responded) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:91) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:66) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:297) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:268) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:88) ... 23 common frames omitted 2021-07-29 07:32:00.888 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1799163683-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@27a9d1c5 at consistency null 2021-07-29 07:32:00.888 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1799163683-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:00.918 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [425017998-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@25e3d88f at consistency null 2021-07-29 07:32:00.918 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [425017998-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:00.947 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [453346276-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7c3a3245 at consistency null 2021-07-29 07:32:00.947 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [453346276-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:00.976 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [767330704-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7e6f85df at consistency null 2021-07-29 07:32:00.977 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [767330704-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:01.031 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [788258579-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1721442e at consistency null 2021-07-29 07:32:01.031 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [788258579-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:01.085 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [487172464-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2c3dd1e5 at consistency null 2021-07-29 07:32:01.085 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [487172464-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:01.139 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [707003286-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1b8763d at consistency null 2021-07-29 07:32:01.139 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [707003286-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:01.193 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1662906187-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@37b5aa8 at consistency null 2021-07-29 07:32:01.193 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1662906187-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:01.199 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1539820234-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1ee66edd at consistency null 2021-07-29 07:32:01.199 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1539820234-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:01.201 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT9.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-29 07:32:01.249 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [334407548-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5c16361d at consistency null 2021-07-29 07:32:01.249 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [334407548-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:01.303 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1132256856-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1e5dba3c at consistency null 2021-07-29 07:32:01.303 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1132256856-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:01.357 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1238261010-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@472a1d45 at consistency null 2021-07-29 07:32:01.358 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1238261010-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:01.462 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1160090839-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6a1703fb at consistency null 2021-07-29 07:32:01.462 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1160090839-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:01.666 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [588648008-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7dc667a at consistency null 2021-07-29 07:32:01.666 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [588648008-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:01.883 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [104696428-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7423a0e7 at consistency null 2021-07-29 07:32:01.883 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [104696428-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:02.087 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1033920884-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@63f44b13 at consistency null 2021-07-29 07:32:02.087 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1033920884-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:02.293 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1414191419-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@31ae844d at consistency null 2021-07-29 07:32:02.294 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1414191419-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:02.497 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1195239860-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5525cbb4 at consistency null 2021-07-29 07:32:02.498 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1195239860-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:02.902 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [767129045-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3ce86d6f at consistency null 2021-07-29 07:32:02.902 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [767129045-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:03.706 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [330046167-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7d051532 at consistency null 2021-07-29 07:32:03.706 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [330046167-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:03.708 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:31:35.281Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-29 07:32:06.007 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:32:06.009 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-12, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:32:06.009 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-12, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:32:06.009 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-12, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:32:06.009 DEBUG --- [er-nio-worker-3] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-12, inFlight=0, closed=true] closing connection 2021-07-29 07:32:06.009 DEBUG --- [luster-worker-1] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:32:06.010 DEBUG --- [-reconnection-1] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 32000 milliseconds 2021-07-29 07:32:06.010 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 32000 ms 2021-07-29 07:32:08.709 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:32:08.711 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-10, inFlight=0, closed=false] Error connecting to cassandra/10.242.120.196:9042 (syscall:getsockopt(..) failed: Connection refused: cassandra/10.242.120.196:9042) 2021-07-29 07:32:08.712 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : Defuncting Connection[cassandra/10.242.120.196:9042-10, inFlight=0, closed=false] because: [cassandra/10.242.120.196:9042] Cannot connect 2021-07-29 07:32:08.712 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] Connection[cassandra/10.242.120.196:9042-10, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:32:08.712 DEBUG --- [er-nio-worker-0] com.datastax.driver.core.Connection : Connection[cassandra/10.242.120.196:9042-10, inFlight=0, closed=true] closing connection 2021-07-29 07:32:08.712 DEBUG --- [luster-worker-0] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host cassandra/10.242.120.196:9042 2021-07-29 07:32:08.712 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to cassandra/10.242.120.196:9042 ([cassandra/10.242.120.196:9042] Cannot connect), scheduling retry in 64000 milliseconds 2021-07-29 07:32:08.712 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [cassandra/10.242.120.196:9042] next reconnection attempt in 64000 ms 2021-07-29 07:32:08.713 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [296585880-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@384c7a33 at consistency null 2021-07-29 07:32:08.714 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [296585880-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:08.783 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [972403024-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@43cf7ee5 at consistency null 2021-07-29 07:32:08.783 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [972403024-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:08.887 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1594129510-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3c33e0e6 at consistency null 2021-07-29 07:32:08.888 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1594129510-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:09.092 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [747487219-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@69caced7 at consistency null 2021-07-29 07:32:09.092 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [747487219-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:09.296 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1359546800-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@328cbc3f at consistency null 2021-07-29 07:32:09.296 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1359546800-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:09.500 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1172458992-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@a8cc4dd at consistency null 2021-07-29 07:32:09.500 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1172458992-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:09.979 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [972684902-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@291b31ba at consistency null 2021-07-29 07:32:09.979 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [972684902-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:10.784 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2026548365-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1698fe38 at consistency null 2021-07-29 07:32:10.784 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2026548365-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:10.806 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [792078728-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4122d590 at consistency null 2021-07-29 07:32:10.806 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [792078728-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:10.807 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT9.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-29 07:32:12.388 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1637314221-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2d644b45 at consistency null 2021-07-29 07:32:12.389 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1637314221-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:12.391 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:31:35.281Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-29 07:32:14.488 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preparing to open 1 new connections, total = 2 2021-07-29 07:32:14.499 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-9, inFlight=0, closed=false] Connection established, initializing transport 2021-07-29 07:32:14.503 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.112.75:9042-9, inFlight=0, closed=false] because: Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:32:14.504 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] preventing new connections for the next 1000 ms 2021-07-29 07:32:14.504 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-9, inFlight=0, closed=false] failed, remaining = 1 2021-07-29 07:32:14.504 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-9, inFlight=0, closed=true] closing connection 2021-07-29 07:32:14.504 ERROR --- [-reconnection-1] c.d.d.core.AbstractReconnectionHandler : Authentication error on host /10.242.112.75:9042: Error during authentication of user cassandra : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level QUORUM 2021-07-29 07:32:14.505 DEBUG --- [-reconnection-1] com.datastax.driver.core.Host.STATES : [Control connection] next reconnection attempt in 64000 ms 2021-07-29 07:32:14.505 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-9, inFlight=0, closed=true] has already terminated 2021-07-29 07:32:17.478 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [919413410-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@54d2e91c at consistency null 2021-07-29 07:32:17.479 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [919413410-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:17.578 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1077014739-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@18d1959d at consistency null 2021-07-29 07:32:17.579 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1077014739-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:17.678 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1840419484-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@471c5146 at consistency null 2021-07-29 07:32:17.678 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1840419484-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:17.778 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [931822465-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1434f7c at consistency null 2021-07-29 07:32:17.778 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [931822465-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:17.878 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1754105824-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@429adc41 at consistency null 2021-07-29 07:32:17.878 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1754105824-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:17.978 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [670389578-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@5673d4f2 at consistency null 2021-07-29 07:32:17.979 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [670389578-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:18.078 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1579816282-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@73c0391b at consistency null 2021-07-29 07:32:18.078 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1579816282-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:18.182 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [983055213-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@68e3b0b0 at consistency null 2021-07-29 07:32:18.182 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [983055213-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:18.387 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1043208537-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@7c0f0139 at consistency null 2021-07-29 07:32:18.387 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1043208537-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:18.597 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [863786195-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@34939e0e at consistency null 2021-07-29 07:32:18.598 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [863786195-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:19.001 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1039271715-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@46697166 at consistency null 2021-07-29 07:32:19.002 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1039271715-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:19.405 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1187643555-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@33fa3f2b at consistency null 2021-07-29 07:32:19.405 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1187643555-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:20.210 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [148909554-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@37f8f6a4 at consistency null 2021-07-29 07:32:20.210 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [148909554-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:20.212 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:31:35.281Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-29 07:32:20.413 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [508065150-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@1f337dbb at consistency null 2021-07-29 07:32:20.413 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [508065150-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:20.414 WARN --- [raphID(0)(4)[0]] o.j.d.i.ConsistentKeyIDAuthority : Temporary storage exception while acquiring id block - retrying in PT9.6S: {} org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:175) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority$1.call(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getCurrentID(ConsistentKeyIDAuthority.java:172) at org.janusgraph.diskstorage.idmanagement.ConsistentKeyIDAuthority.getIDBlock(ConsistentKeyIDAuthority.java:237) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:288) at org.janusgraph.graphdb.database.idassigner.StandardIDPool$IDBlockGetter.call(StandardIDPool.java:255) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ... 4 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-29 07:32:25.279 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1500199665-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@125ccd7a at consistency null 2021-07-29 07:32:25.279 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1500199665-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:25.378 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1955456480-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@70bdab7d at consistency null 2021-07-29 07:32:25.378 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1955456480-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:25.479 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1658076362-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@2e18 at consistency null 2021-07-29 07:32:25.479 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1658076362-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:25.583 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1800540895-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@4da5506 at consistency null 2021-07-29 07:32:25.583 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1800540895-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:25.879 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1810760182-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@70197ffa at consistency null 2021-07-29 07:32:25.879 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1810760182-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:26.283 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1884773262-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@6de2c4c7 at consistency null 2021-07-29 07:32:26.283 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1884773262-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:26.612 ERROR --- [ main] org.onap.aai.logging.ErrorLogHelper : ERR.5.4.4000 ex=org.onap.aai.exceptions.AAIException: ID block allocation on partition(0)-namespace(4) timed out in 2.000 min ClassName- org.onap.aai.logging.ErrorLogHelper :LineNumber- 616 :MethodName- logError ClassName- org.onap.aai.schema.GenTester :LineNumber- 163 :MethodName- main ClassName- sun.reflect.NativeMethodAccessorImpl :LineNumber- -2 :MethodName- invoke0 ClassName- sun.reflect.NativeMethodAccessorImpl :LineNumber- 62 :MethodName- invoke ClassName- sun.reflect.DelegatingMethodAccessorImpl :LineNumber- 43 :MethodName- invoke ClassName- java.lang.reflect.Method :LineNumber- 498 :MethodName- invoke ClassName- org.springframework.boot.loader.MainMethodRunner :LineNumber- 48 :MethodName- run ClassName- org.springframework.boot.loader.Launcher :LineNumber- 87 :MethodName- launch ClassName- org.springframework.boot.loader.Launcher :LineNumber- 50 :MethodName- launch ClassName- org.springframework.boot.loader.PropertiesLauncher :LineNumber- 595 :MethodName- main 2021-07-29 07:32:26.681 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1089268437-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@6c93478d at consistency null 2021-07-29 07:32:26.681 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1089268437-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:26.686 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [858135330-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3a374d7c at consistency null 2021-07-29 07:32:26.686 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [858135330-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:26.784 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1678923217-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@1ea036f at consistency null 2021-07-29 07:32:26.784 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1678923217-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:26.882 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1976965986-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@7ad53b69 at consistency null 2021-07-29 07:32:26.882 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1976965986-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:26.981 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1947573705-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@c0ca491 at consistency null 2021-07-29 07:32:26.981 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1947573705-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:27.086 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1393060828-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@cd044c1 at consistency null 2021-07-29 07:32:27.086 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1393060828-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:27.289 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [625086641-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@5d70cf4f at consistency null 2021-07-29 07:32:27.290 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [625086641-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:27.490 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1217995635-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@e2db9fb at consistency null 2021-07-29 07:32:27.490 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1217995635-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:27.494 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1611272816-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@67ecbc83 at consistency null 2021-07-29 07:32:27.494 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1611272816-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:27.703 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [942223469-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@69941af3 at consistency null 2021-07-29 07:32:27.703 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [942223469-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:27.907 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [686815807-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@3245aa39 at consistency null 2021-07-29 07:32:27.907 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [686815807-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:28.178 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [488480779-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@51c43feb at consistency null 2021-07-29 07:32:28.178 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [488480779-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:28.295 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1407412775-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@534e89f4 at consistency null 2021-07-29 07:32:28.295 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1407412775-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:28.583 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [766814282-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@1ac442ec at consistency null 2021-07-29 07:32:28.583 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [766814282-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:28.987 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1559191497-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@54f27ef at consistency null 2021-07-29 07:32:28.987 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1559191497-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:29.100 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [421708030-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@75847bca at consistency null 2021-07-29 07:32:29.100 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [421708030-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:29.102 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:31:35.281Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-29 07:32:29.395 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [193362025-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@52a24da7 at consistency null 2021-07-29 07:32:29.396 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [193362025-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:29.801 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2070645994-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@6ac9a63d at consistency null 2021-07-29 07:32:29.801 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [2070645994-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:30.205 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1930792245-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@16c584d4 at consistency null 2021-07-29 07:32:30.206 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1930792245-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:30.610 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1436718473-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@4049f7ed at consistency null 2021-07-29 07:32:30.610 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1436718473-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:31.014 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1835002468-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@465536 at consistency null 2021-07-29 07:32:31.015 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1835002468-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:31.419 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1249126393-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@2799e34d at consistency null 2021-07-29 07:32:31.419 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1249126393-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:32.223 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [358049703-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@1d40204e at consistency null 2021-07-29 07:32:32.223 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [358049703-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:33.082 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1410901593-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@12394a94 at consistency null 2021-07-29 07:32:33.082 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1410901593-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:34.180 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [442382323-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@20e45200 at consistency null 2021-07-29 07:32:34.181 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [442382323-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:34.278 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [467475824-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@488f4eda at consistency null 2021-07-29 07:32:34.279 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [467475824-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:34.384 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1395125886-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@54d155d5 at consistency null 2021-07-29 07:32:34.384 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1395125886-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:34.587 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1544413652-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@ce4d831 at consistency null 2021-07-29 07:32:34.587 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1544413652-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:34.686 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1174829684-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@e12ffff at consistency null 2021-07-29 07:32:34.686 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1174829684-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:34.990 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [931640329-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@3cd98979 at consistency null 2021-07-29 07:32:34.990 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [931640329-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:35.478 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1153566996-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@62781cca at consistency null 2021-07-29 07:32:35.478 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1153566996-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:35.882 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [679107564-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@487765e4 at consistency null 2021-07-29 07:32:35.882 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [679107564-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:36.285 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [466230390-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@51838612 at consistency null 2021-07-29 07:32:36.286 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [466230390-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:36.297 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [757515938-0] Doing retry 1 for query com.datastax.driver.core.BatchStatement@21615f1a at consistency null 2021-07-29 07:32:36.297 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [757515938-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:37.091 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [292017402-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@35d89b0 at consistency null 2021-07-29 07:32:37.091 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [292017402-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:37.978 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1161426283-0] Doing retry 1 for query com.datastax.driver.core.BoundStatement@70f6847a at consistency null 2021-07-29 07:32:37.978 DEBUG --- [er-nio-worker-1] com.datastax.driver.core.RequestHandler : [1161426283-0] Error querying /10.242.112.75:9042 : com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive) 2021-07-29 07:32:37.980 WARN --- [pool-8-thread-1] o.j.diskstorage.log.kcvs.KCVSLog : Could not read messages for timestamp [2021-07-29T07:31:35.281Z] (this read will be retried) org.janusgraph.core.JanusGraphException: Could not execute operation due to backend exception at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:57) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:159) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller.run(KCVSLog.java:732) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Could not successfully complete backend operation due to repeated temporary exceptions after PT4S at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:101) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:55) ... 9 common frames omitted Caused by: org.janusgraph.diskstorage.TemporaryBackendException: Temporary failure in storage backend at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$null$2(CQLKeyColumnValueStore.java:126) at io.vavr.API$Match$Case0.apply(API.java:3174) at io.vavr.API$Match.of(API.java:3137) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.lambda$static$3(CQLKeyColumnValueStore.java:123) at io.vavr.control.Try.getOrElseThrow(Try.java:671) at org.janusgraph.diskstorage.cql.CQLKeyColumnValueStore.getSlice(CQLKeyColumnValueStore.java:290) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:798) at org.janusgraph.diskstorage.log.kcvs.KCVSLog$MessagePuller$1.call(KCVSLog.java:795) at org.janusgraph.diskstorage.util.BackendOperation.execute(BackendOperation.java:148) at org.janusgraph.diskstorage.util.BackendOperation$1.call(BackendOperation.java:162) at org.janusgraph.diskstorage.util.BackendOperation.executeDirect(BackendOperation.java:69) ... 10 common frames omitted Caused by: java.util.concurrent.ExecutionException: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:476) at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:455) at io.vavr.control.Try.of(Try.java:62) at io.vavr.concurrent.FutureImpl.lambda$run$2(FutureImpl.java:199) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 common frames omitted Caused by: com.datastax.driver.core.exceptions.NoHostAvailableException: All host(s) tried for query failed (tried: /10.242.112.75:9042 (com.datastax.driver.core.exceptions.UnavailableException: Not enough replicas available for query at consistency LOCAL_QUORUM (2 required but only 1 alive))) at com.datastax.driver.core.RequestHandler.reportNoMoreHosts(RequestHandler.java:265) at com.datastax.driver.core.RequestHandler.access$1200(RequestHandler.java:62) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.findNextHostAndQuery(RequestHandler.java:357) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.retry(RequestHandler.java:539) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.processRetryDecision(RequestHandler.java:521) at com.datastax.driver.core.RequestHandler$SpeculativeExecution.onSet(RequestHandler.java:791) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233) at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151) at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:312) at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:286) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86) at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:335) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1304) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:356) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:342) at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:921) at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:725) at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:400) at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:300) at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:131) at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 common frames omitted 2021-07-29 07:32:38.010 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] preparing to open 1 new connections, total = 1 2021-07-29 07:32:38.013 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-13, inFlight=0, closed=false] Error connecting to /10.242.179.73:9042 (syscall:getsockopt(..) failed: Connection refused: /10.242.179.73:9042) 2021-07-29 07:32:38.014 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : Defuncting Connection[/10.242.179.73:9042-13, inFlight=0, closed=false] because: [/10.242.179.73:9042] Cannot connect 2021-07-29 07:32:38.014 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] Connection[/10.242.179.73:9042-13, inFlight=0, closed=false] failed, remaining = 0 2021-07-29 07:32:38.014 DEBUG --- [er-nio-worker-2] com.datastax.driver.core.Connection : Connection[/10.242.179.73:9042-13, inFlight=0, closed=true] closing connection 2021-07-29 07:32:38.015 DEBUG --- [-reconnection-0] com.datastax.driver.core.Cluster : Failed reconnection to /10.242.179.73:9042 ([/10.242.179.73:9042] Cannot connect), scheduling retry in 64000 milliseconds 2021-07-29 07:32:38.015 DEBUG --- [-reconnection-0] com.datastax.driver.core.Host.STATES : [/10.242.179.73:9042] next reconnection attempt in 64000 ms 2021-07-29 07:32:38.014 DEBUG --- [luster-worker-2] com.datastax.driver.core.Cluster : Aborting onDown because a reconnection is running on DOWN host /10.242.179.73:9042 2021-07-29 07:32:39.779 DEBUG --- [ main] com.datastax.driver.core.Connection : Connection[/10.242.112.75:9042-7, inFlight=0, closed=true] closing connection 2021-07-29 07:32:39.779 DEBUG --- [ main] com.datastax.driver.core.Host.STATES : [/10.242.112.75:9042] Connection[/10.242.112.75:9042-7, inFlight=0, closed=true] closed, remaining = 0 2021-07-29 07:32:39.780 DEBUG --- [ main] com.datastax.driver.core.Cluster : Shutting down 2021-07-29 07:32:39.785 DEBUG --- [er-nio-worker-3] io.netty.buffer.PoolThreadCache : Freed 117 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-3 2021-07-29 07:32:40.888 DEBUG --- [er-nio-worker-2] io.netty.buffer.PoolThreadCache : Freed 4 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-2 2021-07-29 07:32:41.986 DEBUG --- [er-nio-worker-1] io.netty.buffer.PoolThreadCache : Freed 137 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-1 2021-07-29 07:32:41.986 DEBUG --- [er-nio-worker-0] io.netty.buffer.PoolThreadCache : Freed 71 thread-local buffer(s) from thread: JanusGraph Cluster-nio-worker-0 Failed to run the tool /opt/app/aai-graphadmin/bin/createDBSchema.sh successfully Failed to run the createDBSchema.sh