By type
Running startup script to get password from certman
10:42:46,037 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
10:42:46,038 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
10:42:46,038 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/opt/app/music/MUSIC-SB.jar!/BOOT-INF/lib/MUSIC-core-3.2.40.jar!/logback.xml]
10:42:46,126 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@28c97a5 - URL [jar:file:/opt/app/music/MUSIC-SB.jar!/BOOT-INF/lib/MUSIC-core-3.2.40.jar!/logback.xml] is not of type file
10:42:46,337 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
10:42:46,351 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Will scan for changes in [jar:file:/opt/app/music/MUSIC-SB.jar!/BOOT-INF/lib/MUSIC-core-3.2.40.jar!/logback.xml]
10:42:46,352 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - Setting ReconfigureOnChangeTask scanning period to 3 seconds
10:42:46,417 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
10:42:46,427 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
10:42:46,438 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.PatternLayout] for [layout] property
10:42:46,634 |-WARN in ch.qos.logback.core.ConsoleAppender[STDOUT] - This appender no longer admits a layout as a sub-component, set an encoder instead.
10:42:46,634 |-WARN in ch.qos.logback.core.ConsoleAppender[STDOUT] - To ensure compatibility, wrapping your layout in LayoutWrappingEncoder.
10:42:46,634 |-WARN in ch.qos.logback.core.ConsoleAppender[STDOUT] - See also http://logback.qos.ch/codes.html#layoutInsteadOfEncoder for details
10:42:46,635 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:42:46,640 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [EELF]
10:42:46,650 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1717159510 - setting totalSizeCap to 5 GB
10:42:46,719 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1717159510 - Archive files will be limited to [1 GB] each.
10:42:46,723 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1717159510 - Will use zip compression
10:42:46,726 |-INFO in c.q.l.core.rolling.SizeAndTimeBasedRollingPolicy@1717159510 - Will use the pattern /opt/app/music/logs/MUSIC/music.%d{yyyy-MM-dd}.%i.log for the active file
10:42:46,731 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6d5380c2 - The date pattern is 'yyyy-MM-dd' from file name pattern '/opt/app/music/logs/MUSIC/music.%d{yyyy-MM-dd}.%i.log.zip'.
10:42:46,731 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6d5380c2 - Roll-over at midnight.
10:42:46,735 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@6d5380c2 - Setting initial period to Wed Apr 28 10:42:46 UTC 2021
10:42:46,738 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:42:46,742 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELF] - Active log file name: /opt/app/music/logs/MUSIC/music.log
10:42:46,742 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELF] - File property is set to [/opt/app/music/logs/MUSIC/music.log]
10:42:46,743 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender]
10:42:46,746 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [asyncEELF]
10:42:46,747 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [EELF] to ch.qos.logback.classic.AsyncAppender[asyncEELF]
10:42:46,747 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELF] - Attaching appender named [EELF] to AsyncAppender.
10:42:46,747 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELF] - Setting discardingThreshold to 51
10:42:46,748 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:42:46,748 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [EELFSecurity]
10:42:46,750 |-INFO in ch.qos.logback.core.rolling.FixedWindowRollingPolicy@45ff54e6 - Will use zip compression
10:42:46,752 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:42:46,752 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELFSecurity] - Active log file name: /opt/app/music/logs/MUSIC/security.log
10:42:46,752 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELFSecurity] - File property is set to [/opt/app/music/logs/MUSIC/security.log]
10:42:46,752 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender]
10:42:46,753 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [asyncEELFSecurity]
10:42:46,753 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [EELFSecurity] to ch.qos.logback.classic.AsyncAppender[asyncEELFSecurity]
10:42:46,753 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELFSecurity] - Attaching appender named [EELFSecurity] to AsyncAppender.
10:42:46,753 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELFSecurity] - Setting discardingThreshold to 0
10:42:46,753 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:42:46,753 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [EELFAudit]
10:42:46,754 |-INFO in ch.qos.logback.core.rolling.FixedWindowRollingPolicy@2328c243 - Will use zip compression
10:42:46,754 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:42:46,812 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELFAudit] - Active log file name: /opt/app/music/logs/MUSIC/audit.log
10:42:46,812 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELFAudit] - File property is set to [/opt/app/music/logs/MUSIC/audit.log]
10:42:46,812 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender]
10:42:46,812 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [asyncEELFAudit]
10:42:46,812 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [EELFAudit] to ch.qos.logback.classic.AsyncAppender[asyncEELFAudit]
10:42:46,812 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELFAudit] - Attaching appender named [EELFAudit] to AsyncAppender.
10:42:46,812 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELFAudit] - Setting discardingThreshold to 51
10:42:46,813 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:42:46,813 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [EELFMetrics]
10:42:46,814 |-INFO in ch.qos.logback.core.rolling.FixedWindowRollingPolicy@bebdb06 - Will use zip compression
10:42:46,815 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:42:46,816 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELFMetrics] - Active log file name: /opt/app/music/logs/MUSIC/metrics.log
10:42:46,816 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELFMetrics] - File property is set to [/opt/app/music/logs/MUSIC/metrics.log]
10:42:46,816 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender]
10:42:46,816 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [asyncEELFMetrics]
10:42:46,816 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [EELFMetrics] to ch.qos.logback.classic.AsyncAppender[asyncEELFMetrics]
10:42:46,816 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELFMetrics] - Attaching appender named [EELFMetrics] to AsyncAppender.
10:42:46,816 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELFMetrics] - Setting discardingThreshold to 51
10:42:46,817 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:42:46,817 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [EELFError]
10:42:46,818 |-INFO in ch.qos.logback.core.rolling.FixedWindowRollingPolicy@7a4f0f29 - Will use zip compression
10:42:46,818 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:42:46,819 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELFError] - Active log file name: /opt/app/music/logs/MUSIC/error.log
10:42:46,819 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELFError] - File property is set to [/opt/app/music/logs/MUSIC/error.log]
10:42:46,819 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender]
10:42:46,820 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [asyncEELFError]
10:42:46,820 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [EELFError] to ch.qos.logback.classic.AsyncAppender[asyncEELFError]
10:42:46,820 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELFError] - Attaching appender named [EELFError] to AsyncAppender.
10:42:46,820 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELFError] - Setting discardingThreshold to 51
10:42:46,820 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]
10:42:46,820 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [EELFDebug]
10:42:46,821 |-INFO in ch.qos.logback.core.rolling.FixedWindowRollingPolicy@45283ce2 - Will use zip compression
10:42:46,822 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
10:42:46,822 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELFDebug] - Active log file name: debug-logs/MUSIC/debug.log
10:42:46,822 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[EELFDebug] - File property is set to [debug-logs/MUSIC/debug.log]
10:42:46,823 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.classic.AsyncAppender]
10:42:46,823 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [asyncEELFDebug]
10:42:46,823 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [EELFDebug] to ch.qos.logback.classic.AsyncAppender[asyncEELFDebug]
10:42:46,823 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELFDebug] - Attaching appender named [EELFDebug] to AsyncAppender.
10:42:46,823 |-INFO in ch.qos.logback.classic.AsyncAppender[asyncEELFDebug] - Setting discardingThreshold to 51
10:42:46,824 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att.eelf] to INFO
10:42:46,824 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.att.eelf] to false
10:42:46,824 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [asyncEELF] to Logger[com.att.eelf]
10:42:46,824 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att.eelf.security] to INFO
10:42:46,824 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.att.eelf.security] to false
10:42:46,824 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [asyncEELFSecurity] to Logger[com.att.eelf.security]
10:42:46,824 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att.eelf.audit] to INFO
10:42:46,824 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.att.eelf.audit] to false
10:42:46,824 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [asyncEELFAudit] to Logger[com.att.eelf.audit]
10:42:46,824 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att.eelf.metrics] to INFO
10:42:46,825 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.att.eelf.metrics] to false
10:42:46,825 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [asyncEELFMetrics] to Logger[com.att.eelf.metrics]
10:42:46,825 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att.eelf.error] to ERROR
10:42:46,825 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.att.eelf.error] to false
10:42:46,825 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [asyncEELFError] to Logger[com.att.eelf.error]
10:42:46,825 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.att.eelf.debug] to DEBUG
10:42:46,825 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting additivity of logger [com.att.eelf.debug] to false
10:42:46,825 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [asyncEELFDebug] to Logger[com.att.eelf.debug]
10:42:46,825 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to INFO
10:42:46,825 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [asyncEELF] to Logger[ROOT]
10:42:46,825 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
10:42:46,825 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.datastax.driver.core.Cluster] to ERROR
10:42:46,825 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [org.onap.music.main.MusicCore] to ERROR
10:42:46,825 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
10:42:46,830 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@2077d4de - Registering current configuration as safe fallback point
. ____ _ __ _ _
/\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \
( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \
\\/ ___)| |_)| | | | | || (_| | ) ) ) )
' |____| .__|_| |_|_| |_\__, | / / / /
=========|_|==============|___/=/_/_/_/
:: Spring Boot :: (v2.1.1.RELEASE)
2021-04-28 10:42:50 [main] INFO org.onap.music.MusicApplication - Starting MusicApplication on onap-music-64d55f77f9-hjddv with PID 6 (/opt/app/music/MUSIC-SB.jar started by music in /opt/app/music)
2021-04-28 10:42:50 [main] INFO org.onap.music.MusicApplication - No active profile set, falling back to default profiles: default
2021-04-28 10:42:54 [main] INFO o.s.d.r.c.RepositoryConfigurationDelegate - Bootstrapping Spring Data repositories in DEFAULT mode.
2021-04-28 10:42:54 [main] INFO o.s.d.r.c.RepositoryConfigurationDelegate - Finished Spring Data repository scanning in 96ms. Found 0 repository interfaces.
2021-04-28 10:42:54 [main] INFO o.s.d.r.c.RepositoryConfigurationDelegate - Bootstrapping Spring Data repositories in DEFAULT mode.
2021-04-28 10:42:54 [main] INFO o.s.d.r.c.RepositoryConfigurationDelegate - Finished Spring Data repository scanning in 75ms. Found 0 repository interfaces.
2021-04-28 10:42:58 [main] INFO o.s.b.w.e.tomcat.TomcatWebServer - Tomcat initialized with port(s): 8443 (https)
2021-04-28 10:42:58 [main] INFO o.a.coyote.http11.Http11NioProtocol - Initializing ProtocolHandler ["https-jsse-nio-8443"]
2021-04-28 10:42:58 [main] INFO o.a.catalina.core.StandardService - Starting service [Tomcat]
2021-04-28 10:42:58 [main] INFO o.a.catalina.core.StandardEngine - Starting Servlet Engine: Apache Tomcat/9.0.13
2021-04-28 10:42:58 [main] INFO o.a.c.core.AprLifecycleListener - The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: [/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib]
2021-04-28 10:42:58 [main] INFO o.a.c.c.C.[.[.[/MUSIC/rest] - Initializing Spring embedded WebApplicationContext
2021-04-28 10:42:58 [main] INFO o.s.web.context.ContextLoader - Root WebApplicationContext: initialization completed in 7783 ms
2021-04-28 10:42:58 [main] INFO org.onap.music.MusicApplication - loggingFilterRegistration called for log filter..
2021-04-28 10:42:58 [main] INFO org.onap.music.MusicApplication - cadiFilterRegistration called for cadi filter..
2021-04-28 10:42:58 [main] INFO org.onap.music.MusicApplication - cadiFilterRegistrationForAuth called for cadi auth filter..
2021-04-28 10:42:59 [main] INFO org.reflections.Reflections - Reflections took 194 ms to scan 2 urls, producing 110 keys and 158 values
2021-04-28 10:43:01 [main] INFO o.s.s.c.ThreadPoolTaskExecutor - Initializing ExecutorService 'applicationTaskExecutor'
2021-04-28 10:43:01 [main] INFO com.datastax.driver.core - DataStax Java driver 3.6.0 for Apache Cassandra
2021-04-28 10:43:02 [main] INFO c.d.driver.core.GuavaCompatibility - Detected Guava >= 19 in the classpath, using modern compatibility layer
2021-04-28 10:43:02 [main] INFO c.datastax.driver.core.ClockFactory - Using native clock to generate timestamps.
2021-04-28 10:43:02 [main] INFO o.s.s.c.ThreadPoolTaskScheduler - Initializing ExecutorService 'taskScheduler'
2021-04-28 10:43:03 [main] INFO o.a.coyote.http11.Http11NioProtocol - Starting ProtocolHandler ["https-jsse-nio-8443"]
2021-04-28 10:43:03 [main] INFO o.a.tomcat.util.net.NioSelectorPool - Using a shared selector for servlet write/read
2021-04-28 10:43:03 [main] INFO o.s.b.w.e.tomcat.TomcatWebServer - Tomcat started on port(s): 8443 (https) with context path '/MUSIC/rest'
2021-04-28 10:43:03 [main] INFO org.onap.music.MusicApplication - Started MusicApplication in 16.094 seconds (JVM running for 18.635)
2021-04-28 10:43:03 [Thread-17] INFO c.datastax.driver.core.ClockFactory - Using native clock to generate timestamps.
2021-04-28 10:43:03 [Thread-17] INFO com.datastax.driver.core.NettyUtil - Did not find Netty's native epoll transport in the classpath, defaulting to NIO.
2021-04-28 10:43:05 [Thread-17] INFO c.d.d.c.p.DCAwareRoundRobinPolicy - Using data-center name 'datacenter1' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor)
2021-04-28 10:52:34 [https-jsse-nio-8443-exec-5] WARN org.glassfish.jersey.internal.Errors - The following warnings have been detected: WARNING: The (sub)resource method simpleTests in org.onap.music.rest.RestMusicTestAPI contains empty path annotation.
WARNING: A HTTP GET method, public javax.ws.rs.core.Response org.onap.music.rest.RestMusicDataAPI.selectWithCritical(java.lang.String,java.lang.String,java.lang.String,java.lang.String,java.lang.String,java.lang.String,org.onap.music.datastore.jsonobjects.JsonInsert,java.lang.String,java.lang.String,javax.ws.rs.core.UriInfo) throws java.lang.Exception, should not consume any entity.
2021-04-28 10:52:34 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery keyspaceName ::conductor
2021-04-28 10:52:34 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:52:34 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:52:34 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:52:43 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery indexName ::
2021-04-28 10:52:43 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery keyspaceName ::conductor
2021-04-28 10:52:43 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery tableName ::plans
2021-04-28 10:52:43 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery fieldName ::status
2021-04-28 10:52:53 [https-jsse-nio-8443-exec-4] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:52:53 [https-jsse-nio-8443-exec-4] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:52:53 [https-jsse-nio-8443-exec-4] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:52:53 [https-jsse-nio-8443-exec-4] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:53:00 [https-jsse-nio-8443-exec-1] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery indexName ::
2021-04-28 10:53:00 [https-jsse-nio-8443-exec-1] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery keyspaceName ::conductor
2021-04-28 10:53:00 [https-jsse-nio-8443-exec-1] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery tableName ::plans
2021-04-28 10:53:00 [https-jsse-nio-8443-exec-1] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery fieldName ::status
2021-04-28 10:53:00 [https-jsse-nio-8443-exec-2] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery indexName ::
2021-04-28 10:53:00 [https-jsse-nio-8443-exec-2] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery keyspaceName ::conductor
2021-04-28 10:53:00 [https-jsse-nio-8443-exec-2] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery tableName ::plans
2021-04-28 10:53:00 [https-jsse-nio-8443-exec-2] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery fieldName ::status
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:55:02 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:56:54 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonInsert - (conductor) Data insert Query ::::: INSERT INTO conductor.plans (vector_ts,id,created,message,name,recommend_max,solution,status,template,timeout,translation,updated) VALUES (?,?,?,?,?,?,?,?,?,?,?,?);
2021-04-28 10:56:54 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonInsert - (conductor) Data insert Query ::::: INSERT INTO conductor.plans (vector_ts,id,created,message,name,recommend_max,solution,status,template,timeout,translation,updated) VALUES (?,?,?,?,?,?,?,?,?,?,?,?);
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery keyspaceName ::conductor
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery keyspaceName ::conductor
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery keyspaceName ::conductor
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:57:53 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:57:54 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery indexName ::
2021-04-28 10:57:54 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery keyspaceName ::conductor
2021-04-28 10:57:54 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery tableName ::plans
2021-04-28 10:57:54 [https-jsse-nio-8443-exec-9] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery fieldName ::status
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-3] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery keyspaceName ::conductor
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-3] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-3] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-3] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery keyspaceName ::conductor
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery keyspaceName ::conductor
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-8] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:10 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-3] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery indexName ::
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-3] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery keyspaceName ::conductor
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-3] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery tableName ::plans
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-3] INFO o.o.m.d.jsonobjects.JsonIndex - ( conductor ) genCreateIndexQuery fieldName ::status
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-2] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-2] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-2] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-2] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:11 [https-jsse-nio-8443-exec-5] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:15 [https-jsse-nio-8443-exec-4] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:58:15 [https-jsse-nio-8443-exec-4] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:15 [https-jsse-nio-8443-exec-4] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:15 [https-jsse-nio-8443-exec-4] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:15 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:58:15 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:15 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:15 [https-jsse-nio-8443-exec-10] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:16 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery keyspaceName ::conductor_rpc
2021-04-28 10:58:16 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery class :: SimpleStrategy
2021-04-28 10:58:16 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery replication_factor :: 1
2021-04-28 10:58:16 [https-jsse-nio-8443-exec-7] INFO o.o.m.d.jsonobjects.JsonKeySpace - ( conductor_rpc ) genCreateKeyspaceQuery durabilityOfWrites :: true
2021-04-28 10:58:28 [https-jsse-nio-8443-exec-5] INFO o.o.m.service.impl.MusicCassaCore - ( conductor ) In acquire lock: Since there was a forcible release, need to sync quorum!
2021-04-28 10:58:37 [https-jsse-nio-8443-exec-8] ERROR o.o.m.l.cassandra.CassaLockStore - ( conductor ) Executing Session Failure for Request = [delete from conductor.lockQ_plans where key='healthcheck' AND lockReference =4 IF EXISTS;] Reason = Cassandra timeout during CAS write query at consistency SERIAL (1 replica were required but only 0 acknowledged the write)
org.onap.music.exceptions.MusicServiceException: Executing Session Failure for Request = [delete from conductor.lockQ_plans where key='healthcheck' AND lockReference =4 IF EXISTS;] Reason = Cassandra timeout during CAS write query at consistency SERIAL (1 replica were required but only 0 acknowledged the write)
at org.onap.music.datastore.MusicDataStore.executePut(MusicDataStore.java:398)
at org.onap.music.datastore.MusicDataStore.executePut(MusicDataStore.java:331)
at org.onap.music.lockingservice.cassandra.CassaLockStore.deQueueLockRef(CassaLockStore.java:439)
at org.onap.music.service.impl.MusicCassaCore.destroyLockRef(MusicCassaCore.java:499)
at org.onap.music.service.impl.MusicCassaCore.voluntaryReleaseLock(MusicCassaCore.java:525)
at org.onap.music.service.impl.MusicCassaCore.atomicPut(MusicCassaCore.java:867)
at org.onap.music.service.impl.MusicCassaCore.updateTable(MusicCassaCore.java:1163)
at org.onap.music.main.MusicCore.updateTable(MusicCore.java:256)
at org.onap.music.rest.RestMusicDataAPI.updateTable(RestMusicDataAPI.java:583)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191)
at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104)
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268)
at org.glassfish.jersey.internal.Errors.process(Errors.java:316)
at org.glassfish.jersey.internal.Errors.process(Errors.java:298)
at org.glassfish.jersey.internal.Errors.process(Errors.java:268)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289)
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256)
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703)
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416)
at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.onap.music.eelf.logging.MusicLoggingServletFilter.doFilter(MusicLoggingServletFilter.java:157)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:92)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:93)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:200)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:791)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1417)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:58:41 [cluster2-nio-worker-1] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 10:58:41 [cluster2-nio-worker-0] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 10:58:41 [cluster2-nio-worker-1] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.70.238:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 10:58:41 [cluster2-nio-worker-0] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.70.238:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 10:58:41 [cluster2-nio-worker-0] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.70.238:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 10:58:41 [https-jsse-nio-8443-exec-8] ERROR o.o.m.l.cassandra.CassaLockStore - ( conductor ) Executing Session Failure for Request = [delete from conductor.lockQ_plans where key='healthcheck' AND lockReference =4 IF EXISTS;] Reason = An unexpected error occurred server side on music-cassandra/10.233.70.238:9042: com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
org.onap.music.exceptions.MusicServiceException: Executing Session Failure for Request = [delete from conductor.lockQ_plans where key='healthcheck' AND lockReference =4 IF EXISTS;] Reason = An unexpected error occurred server side on music-cassandra/10.233.70.238:9042: com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at org.onap.music.datastore.MusicDataStore.executePut(MusicDataStore.java:398)
at org.onap.music.datastore.MusicDataStore.executePut(MusicDataStore.java:331)
at org.onap.music.lockingservice.cassandra.CassaLockStore.deQueueLockRef(CassaLockStore.java:439)
at org.onap.music.lockingservice.cassandra.CassaLockStore.deQueueLockRef(CassaLockStore.java:448)
at org.onap.music.service.impl.MusicCassaCore.destroyLockRef(MusicCassaCore.java:499)
at org.onap.music.service.impl.MusicCassaCore.voluntaryReleaseLock(MusicCassaCore.java:525)
at org.onap.music.service.impl.MusicCassaCore.atomicPut(MusicCassaCore.java:867)
at org.onap.music.service.impl.MusicCassaCore.updateTable(MusicCassaCore.java:1163)
at org.onap.music.main.MusicCore.updateTable(MusicCore.java:256)
at org.onap.music.rest.RestMusicDataAPI.updateTable(RestMusicDataAPI.java:583)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191)
at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104)
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268)
at org.glassfish.jersey.internal.Errors.process(Errors.java:316)
at org.glassfish.jersey.internal.Errors.process(Errors.java:298)
at org.glassfish.jersey.internal.Errors.process(Errors.java:268)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289)
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256)
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703)
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416)
at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.onap.music.eelf.logging.MusicLoggingServletFilter.doFilter(MusicLoggingServletFilter.java:157)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:92)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:93)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:200)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:791)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1417)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:58:46 [cluster2-nio-worker-1] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 10:58:46 [cluster2-nio-worker-0] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 10:58:47 [cluster2-nio-worker-1] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.70.238:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 10:58:47 [https-jsse-nio-8443-exec-8] ERROR o.o.m.l.cassandra.CassaLockStore - ( conductor ) Executing Session Failure for Request = [delete from conductor.lockQ_plans where key='healthcheck' AND lockReference =4 IF EXISTS;] Reason = An unexpected error occurred server side on music-cassandra/10.233.70.238:9042: com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
org.onap.music.exceptions.MusicServiceException: Executing Session Failure for Request = [delete from conductor.lockQ_plans where key='healthcheck' AND lockReference =4 IF EXISTS;] Reason = An unexpected error occurred server side on music-cassandra/10.233.70.238:9042: com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at org.onap.music.datastore.MusicDataStore.executePut(MusicDataStore.java:398)
at org.onap.music.datastore.MusicDataStore.executePut(MusicDataStore.java:331)
at org.onap.music.lockingservice.cassandra.CassaLockStore.deQueueLockRef(CassaLockStore.java:439)
at org.onap.music.lockingservice.cassandra.CassaLockStore.deQueueLockRef(CassaLockStore.java:448)
at org.onap.music.lockingservice.cassandra.CassaLockStore.deQueueLockRef(CassaLockStore.java:448)
at org.onap.music.service.impl.MusicCassaCore.destroyLockRef(MusicCassaCore.java:499)
at org.onap.music.service.impl.MusicCassaCore.voluntaryReleaseLock(MusicCassaCore.java:525)
at org.onap.music.service.impl.MusicCassaCore.atomicPut(MusicCassaCore.java:867)
at org.onap.music.service.impl.MusicCassaCore.updateTable(MusicCassaCore.java:1163)
at org.onap.music.main.MusicCore.updateTable(MusicCore.java:256)
at org.onap.music.rest.RestMusicDataAPI.updateTable(RestMusicDataAPI.java:583)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191)
at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104)
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268)
at org.glassfish.jersey.internal.Errors.process(Errors.java:316)
at org.glassfish.jersey.internal.Errors.process(Errors.java:298)
at org.glassfish.jersey.internal.Errors.process(Errors.java:268)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289)
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256)
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703)
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416)
at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.onap.music.eelf.logging.MusicLoggingServletFilter.doFilter(MusicLoggingServletFilter.java:157)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:92)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:93)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:200)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:791)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1417)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:58:47 [https-jsse-nio-8443-exec-8] ERROR o.o.m.l.cassandra.CassaLockStore - ( conductor ) Executing Session Failure for Request = [delete from conductor.lockQ_plans where key='healthcheck' AND lockReference =4 IF EXISTS;] Reason = An unexpected error occurred server side on music-cassandra/10.233.70.238:9042: com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
org.onap.music.exceptions.MusicServiceException: Executing Session Failure for Request = [delete from conductor.lockQ_plans where key='healthcheck' AND lockReference =4 IF EXISTS;] Reason = An unexpected error occurred server side on music-cassandra/10.233.70.238:9042: com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at org.onap.music.datastore.MusicDataStore.executePut(MusicDataStore.java:398)
at org.onap.music.datastore.MusicDataStore.executePut(MusicDataStore.java:331)
at org.onap.music.lockingservice.cassandra.CassaLockStore.deQueueLockRef(CassaLockStore.java:439)
at org.onap.music.lockingservice.cassandra.CassaLockStore.deQueueLockRef(CassaLockStore.java:448)
at org.onap.music.lockingservice.cassandra.CassaLockStore.deQueueLockRef(CassaLockStore.java:448)
at org.onap.music.service.impl.MusicCassaCore.destroyLockRef(MusicCassaCore.java:499)
at org.onap.music.service.impl.MusicCassaCore.voluntaryReleaseLock(MusicCassaCore.java:525)
at org.onap.music.service.impl.MusicCassaCore.atomicPut(MusicCassaCore.java:867)
at org.onap.music.service.impl.MusicCassaCore.updateTable(MusicCassaCore.java:1163)
at org.onap.music.main.MusicCore.updateTable(MusicCore.java:256)
at org.onap.music.rest.RestMusicDataAPI.updateTable(RestMusicDataAPI.java:583)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191)
at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104)
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268)
at org.glassfish.jersey.internal.Errors.process(Errors.java:316)
at org.glassfish.jersey.internal.Errors.process(Errors.java:298)
at org.glassfish.jersey.internal.Errors.process(Errors.java:268)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289)
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256)
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703)
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416)
at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.onap.music.eelf.logging.MusicLoggingServletFilter.doFilter(MusicLoggingServletFilter.java:157)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:92)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:93)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:200)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:791)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1417)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:58:49 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 10:58:51 [cluster2-worker-1] ERROR c.d.driver.core.RequestHandler - Unexpected error while querying music-cassandra/10.233.70.238
com.datastax.driver.core.exceptions.ConnectionException: [music-cassandra/10.233.70.238:9042] Pool is shutdown
at com.datastax.driver.core.HostConnectionPool.closeAsync(HostConnectionPool.java:662)
at com.datastax.driver.core.SessionManager.removePool(SessionManager.java:438)
at com.datastax.driver.core.SessionManager.onDown(SessionManager.java:526)
at com.datastax.driver.core.Cluster$Manager.onDown(Cluster.java:2004)
at com.datastax.driver.core.Cluster$Manager.access$1200(Cluster.java:1390)
at com.datastax.driver.core.Cluster$Manager$5.runMayThrow(Cluster.java:1959)
at com.datastax.driver.core.ExceptionCatchingRunnable.run(ExceptionCatchingRunnable.java:32)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:58:51 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 10:58:51 [cluster2-worker-1] ERROR c.d.driver.core.RequestHandler - Unexpected error while querying music-cassandra/10.233.70.238
com.datastax.driver.core.exceptions.ConnectionException: [music-cassandra/10.233.70.238:9042] Pool is shutdown
at com.datastax.driver.core.HostConnectionPool.closeAsync(HostConnectionPool.java:662)
at com.datastax.driver.core.SessionManager.removePool(SessionManager.java:438)
at com.datastax.driver.core.SessionManager.onDown(SessionManager.java:526)
at com.datastax.driver.core.Cluster$Manager.onDown(Cluster.java:2004)
at com.datastax.driver.core.Cluster$Manager.access$1200(Cluster.java:1390)
at com.datastax.driver.core.Cluster$Manager$5.runMayThrow(Cluster.java:1959)
at com.datastax.driver.core.ExceptionCatchingRunnable.run(ExceptionCatchingRunnable.java:32)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:58:51 [cluster2-worker-1] ERROR c.d.driver.core.RequestHandler - Unexpected error while querying music-cassandra/10.233.70.238
com.datastax.driver.core.exceptions.ConnectionException: [music-cassandra/10.233.70.238:9042] Pool is shutdown
at com.datastax.driver.core.HostConnectionPool.closeAsync(HostConnectionPool.java:662)
at com.datastax.driver.core.SessionManager.removePool(SessionManager.java:438)
at com.datastax.driver.core.SessionManager.onDown(SessionManager.java:526)
at com.datastax.driver.core.Cluster$Manager.onDown(Cluster.java:2004)
at com.datastax.driver.core.Cluster$Manager.access$1200(Cluster.java:1390)
at com.datastax.driver.core.Cluster$Manager$5.runMayThrow(Cluster.java:1959)
at com.datastax.driver.core.ExceptionCatchingRunnable.run(ExceptionCatchingRunnable.java:32)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:58:56 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 10:58:56 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 10:58:57 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-04-28 10:58:57 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:58:59 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:58:59 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:58:59 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-04-28 10:58:59 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:59:01 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:01 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:03 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:03 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:03 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-04-28 10:59:03 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:59:04 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:04 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:07 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:07 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:08 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:08 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:11 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-04-28 10:59:11 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:59:12 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:12 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:13 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:13 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:17 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:17 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:18 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:18 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:22 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:22 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:23 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:23 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:27 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:27 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:27 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-04-28 10:59:27 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 32000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 10:59:28 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:28 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:31 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:31 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:34 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:34 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:35 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:35 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:36 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:36 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:39 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:39 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:41 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:41 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:43 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:43 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:45 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:45 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:46 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:46 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:49 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:49 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:51 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:51 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:52 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:52 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:54 [cluster2-blocking-task-worker-0] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 10:59:54 [cluster2-blocking-task-worker-1] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:00:02 [https-jsse-nio-8443-exec-2] ERROR o.o.m.l.cassandra.CassaLockStore - ( conductor ) Executing Session Failure for Request = [delete from conductor.lockQ_plans where key='healthcheck' AND lockReference =4 IF EXISTS;] Reason = Cassandra timeout during CAS write query at consistency SERIAL (1 replica were required but only 0 acknowledged the write)
org.onap.music.exceptions.MusicServiceException: Executing Session Failure for Request = [delete from conductor.lockQ_plans where key='healthcheck' AND lockReference =4 IF EXISTS;] Reason = Cassandra timeout during CAS write query at consistency SERIAL (1 replica were required but only 0 acknowledged the write)
at org.onap.music.datastore.MusicDataStore.executePut(MusicDataStore.java:398)
at org.onap.music.datastore.MusicDataStore.executePut(MusicDataStore.java:331)
at org.onap.music.lockingservice.cassandra.CassaLockStore.deQueueLockRef(CassaLockStore.java:439)
at org.onap.music.service.impl.MusicCassaCore.destroyLockRef(MusicCassaCore.java:499)
at org.onap.music.service.impl.MusicCassaCore.forciblyReleaseLock(MusicCassaCore.java:554)
at org.onap.music.service.impl.MusicCassaCore.evictExpiredLockHolder(MusicCassaCore.java:293)
at org.onap.music.service.impl.MusicCassaCore.acquireLockWithLease(MusicCassaCore.java:270)
at org.onap.music.service.impl.MusicCassaCore.atomicPut(MusicCassaCore.java:835)
at org.onap.music.service.impl.MusicCassaCore.updateTable(MusicCassaCore.java:1163)
at org.onap.music.main.MusicCore.updateTable(MusicCore.java:256)
at org.onap.music.rest.RestMusicDataAPI.updateTable(RestMusicDataAPI.java:583)
at sun.reflect.GeneratedMethodAccessor72.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory.lambda$static$0(ResourceMethodInvocationHandlerFactory.java:76)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:148)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:191)
at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$ResponseOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:200)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:103)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:493)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:415)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:104)
at org.glassfish.jersey.server.ServerRuntime$1.run(ServerRuntime.java:277)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:272)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:268)
at org.glassfish.jersey.internal.Errors.process(Errors.java:316)
at org.glassfish.jersey.internal.Errors.process(Errors.java:298)
at org.glassfish.jersey.internal.Errors.process(Errors.java:268)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:289)
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:256)
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:703)
at org.glassfish.jersey.servlet.WebComponent.serviceImpl(WebComponent.java:416)
at org.glassfish.jersey.servlet.WebComponent.service(WebComponent.java:370)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:389)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:342)
at org.glassfish.jersey.servlet.ServletContainer.service(ServletContainer.java:229)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.onap.music.eelf.logging.MusicLoggingServletFilter.doFilter(MusicLoggingServletFilter.java:157)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:92)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:93)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:200)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:791)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1417)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 11:00:03 [https-jsse-nio-8443-exec-2] INFO o.o.m.service.impl.MusicCassaCore - ( conductor ) In acquire lock: Since there was a forcible release, need to sync quorum!
2021-04-28 11:00:41 [cluster2-timeouter-0] WARN c.d.driver.core.HostConnectionPool - Error creating connection to music-cassandra/10.233.69.35:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [music-cassandra/10.233.69.35:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1496)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1575)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:670)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:745)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:473)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 11:00:41 [cluster2-timeouter-0] WARN c.d.driver.core.HostConnectionPool - Error creating connection to music-cassandra/10.233.69.35:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [music-cassandra/10.233.69.35:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1496)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1575)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:670)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:745)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:473)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 11:00:41 [cluster2-timeouter-0] WARN c.d.driver.core.HostConnectionPool - Error creating connection to music-cassandra/10.233.69.35:9042
com.datastax.driver.core.exceptions.OperationTimedOutException: [music-cassandra/10.233.69.35:9042] Operation timed out
at com.datastax.driver.core.Connection$Future.onTimeout(Connection.java:1496)
at com.datastax.driver.core.Connection$ResponseHandler$1.run(Connection.java:1575)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:670)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:745)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:473)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 11:42:50 [https-jsse-nio-8443-exec-4] INFO o.o.m.d.jsonobjects.JsonInsert - (conductor_rpc) Data insert Query ::::: INSERT INTO conductor_rpc.controller (vector_ts,action,created,updated,ctxt,method,args,status,owner,response,failure,id) VALUES (?,?,?,?,?,?,?,?,?,?,?,?);
2021-04-28 11:42:50 [https-jsse-nio-8443-exec-4] INFO o.o.m.d.jsonobjects.JsonInsert - (conductor_rpc) Data insert Query ::::: INSERT INTO conductor_rpc.controller (vector_ts,action,created,updated,ctxt,method,args,status,owner,response,failure,id) VALUES (?,?,?,?,?,?,?,?,?,?,?,?);
2021-04-28 11:45:14 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonInsert - (conductor_rpc) Data insert Query ::::: INSERT INTO conductor_rpc.controller (vector_ts,action,created,updated,ctxt,method,args,status,owner,response,failure,id) VALUES (?,?,?,?,?,?,?,?,?,?,?,?);
2021-04-28 11:45:14 [https-jsse-nio-8443-exec-6] INFO o.o.m.d.jsonobjects.JsonInsert - (conductor_rpc) Data insert Query ::::: INSERT INTO conductor_rpc.controller (vector_ts,action,created,updated,ctxt,method,args,status,owner,response,failure,id) VALUES (?,?,?,?,?,?,?,?,?,?,?,?);
2021-04-28 11:58:37 [cluster2-nio-worker-1] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.70.238:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 11:58:37 [cluster2-nio-worker-0] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 11:58:37 [cluster2-nio-worker-0] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 11:58:38 [cluster2-nio-worker-1] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.70.238:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 11:58:38 [cluster2-nio-worker-0] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.70.238:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 11:58:43 [cluster2-nio-worker-1] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 11:58:43 [cluster2-nio-worker-1] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 11:58:43 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 11:58:43 [cluster2-nio-worker-1] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.70.238:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 11:58:43 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 11:58:49 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-04-28 11:58:49 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 2000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 11:58:51 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-04-28 11:58:51 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 4000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 11:58:53 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 11:58:53 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 11:58:54 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:58:54 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:58:55 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-04-28 11:58:55 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 8000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 11:58:58 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:58:58 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:58:59 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:58:59 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:00 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:00 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:03 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-04-28 11:59:03 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 16000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 11:59:03 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:03 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:05 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:05 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:09 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:09 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:10 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:10 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:14 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:14 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:15 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:15 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:19 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-04-28 11:59:19 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 32000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 11:59:19 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:19 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:20 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:20 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:24 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:24 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:25 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:25 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:27 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:27 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:29 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:29 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:30 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:30 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:32 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:32 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:34 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:34 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:36 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:36 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:37 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:37 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:40 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:40 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:42 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:42 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:45 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:45 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:47 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:47 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:50 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:50 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:51 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-04-28 11:59:51 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 64000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 11:59:52 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:52 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:53 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:53 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:55 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:55 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:58 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:58 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:59 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 11:59:59 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:01 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:01 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:02 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:02 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:03 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:03 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:06 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:06 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:09 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:09 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:10 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:10 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:12 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:12 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:15 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:15 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:17 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:17 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:20 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:20 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:22 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:22 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:25 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:25 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:26 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:26 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:27 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:27 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:30 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:30 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:32 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:32 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:35 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:35 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:37 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:37 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:41 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:41 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:42 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:42 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:43 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:43 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:47 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:47 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:48 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:48 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:52 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:52 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:53 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:53 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:55 [cluster2-reconnection-1] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
2021-04-28 12:00:55 [cluster2-reconnection-1] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 128000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 12:00:57 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:57 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:58 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:00:58 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:02 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:02 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:04 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:04 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:07 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:07 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:09 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:09 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:12 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:12 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:14 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:14 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:19 [cluster2-blocking-task-worker-5] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:01:19 [cluster2-blocking-task-worker-4] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:02:50 [cluster2-nio-worker-1] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 12:02:50 [cluster2-nio-worker-0] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 12:02:50 [cluster2-nio-worker-1] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 12:02:50 [cluster2-nio-worker-0] WARN c.d.driver.core.RequestHandler - music-cassandra/10.233.78.25:9042 replied with server error (com.google.common.util.concurrent.UncheckedExecutionException: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.), defuncting connection.
2021-04-28 12:03:00 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 12:03:00 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 12:03:06 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 12:03:06 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.)
2021-04-28 12:03:08 [cluster2-reconnection-0] ERROR c.d.d.c.AbstractReconnectionHandler - Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
2021-04-28 12:03:08 [cluster2-reconnection-0] ERROR com.datastax.driver.core.Cluster - Authentication error during reconnection to music-cassandra/10.233.70.238:9042, scheduling retry in 256000 milliseconds
com.datastax.driver.core.exceptions.AuthenticationException: Authentication error on host music-cassandra/10.233.70.238:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.ReadTimeoutException: Operation timed out - received only 0 responses.
at com.datastax.driver.core.Connection$8.apply(Connection.java:503)
at com.datastax.driver.core.Connection$8.apply(Connection.java:465)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:213)
at com.google.common.util.concurrent.AbstractTransformFuture$AsyncTransformFuture.doTransform(AbstractTransformFuture.java:202)
at com.google.common.util.concurrent.AbstractTransformFuture.run(AbstractTransformFuture.java:118)
at com.google.common.util.concurrent.DirectExecutor.execute(DirectExecutor.java:30)
at com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:1138)
at com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:958)
at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:726)
at com.datastax.driver.core.Connection$Future.onSet(Connection.java:1479)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1233)
at com.datastax.driver.core.Connection$Dispatcher.channelRead0(Connection.java:1151)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:105)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:102)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:323)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:297)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:86)
at com.datastax.driver.core.InboundTrafficMeter.channelRead(InboundTrafficMeter.java:38)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1434)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:965)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:648)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:583)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:500)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:462)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:897)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.lang.Thread.run(Thread.java:748)
2021-04-28 12:03:10 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:10 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:11 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:11 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:17 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:17 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:22 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:22 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:26 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:26 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:28 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:28 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:29 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:29 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:33 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:33 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:38 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:38 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:39 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:39 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:43 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:43 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:45 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:45 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:48 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:48 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:50 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:50 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:53 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:53 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:55 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:55 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:59 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:03:59 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:04:00 [cluster2-blocking-task-worker-6] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)
2021-04-28 12:04:00 [cluster2-blocking-task-worker-7] ERROR c.d.driver.core.HostConnectionPool - Authentication error while creating additional connection (error is: Authentication error on host music-cassandra/10.233.78.25:9042: Error during authentication of user nelson24 : org.apache.cassandra.exceptions.UnavailableException: Cannot achieve consistency level LOCAL_ONE)