Results

By type
Logs
raw version
          [38;5;6m [38;5;5m16:30:24.87 [0m
[38;5;6m [38;5;5m16:30:24.88 [0m[1mWelcome to the Bitnami elasticsearch container[0m
[38;5;6m [38;5;5m16:30:24.88 [0mSubscribe to project updates by watching [1mhttps://github.com/bitnami/bitnami-docker-elasticsearch[0m
[38;5;6m [38;5;5m16:30:24.89 [0mSubmit issues and feature requests at [1mhttps://github.com/bitnami/bitnami-docker-elasticsearch/issues[0m
[38;5;6m [38;5;5m16:30:24.89 [0m
[38;5;6m [38;5;5m16:30:24.90 [0m[38;5;2mINFO [0m ==> ** Starting Elasticsearch setup **
[38;5;6m [38;5;5m16:30:24.96 [0m[38;5;2mINFO [0m ==> Configuring/Initializing Elasticsearch...
[38;5;6m [38;5;5m16:30:25.03 [0m[38;5;2mINFO [0m ==> Setting default configuration
[38;5;6m [38;5;5m16:30:25.05 [0m[38;5;2mINFO [0m ==> Configuring Elasticsearch cluster settings...
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[38;5;6m [38;5;5m16:30:28.45 [0m[38;5;2mINFO [0m ==> ** Elasticsearch setup finished! **

[38;5;6m [38;5;5m16:30:28.48 [0m[38;5;2mINFO [0m ==> ** Starting Elasticsearch **
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[2022-10-21T16:30:32,550][INFO ][o.e.n.Node               ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] version[7.9.3], pid[1], build[oss/tar/c4138e51121ef06a6404866cddc601906fe5c868/2020-10-16T10:36:16.141335Z], OS[Linux/5.4.0-96-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/11.0.9/11.0.9+11-LTS]
[2022-10-21T16:30:32,552][INFO ][o.e.n.Node               ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] JVM home [/opt/bitnami/java]
[2022-10-21T16:30:32,553][INFO ][o.e.n.Node               ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms128m, -Xmx128m, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Djava.io.tmpdir=/tmp/elasticsearch-10348420761069354533, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=67108864, -Des.path.home=/opt/bitnami/elasticsearch, -Des.path.conf=/opt/bitnami/elasticsearch/config, -Des.distribution.flavor=oss, -Des.distribution.type=tar, -Des.bundled_jdk=true]
[2022-10-21T16:30:33,961][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [aggs-matrix-stats]
[2022-10-21T16:30:33,962][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [analysis-common]
[2022-10-21T16:30:33,962][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [geo]
[2022-10-21T16:30:33,962][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [ingest-common]
[2022-10-21T16:30:33,962][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [ingest-geoip]
[2022-10-21T16:30:33,962][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [ingest-user-agent]
[2022-10-21T16:30:33,963][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [kibana]
[2022-10-21T16:30:33,963][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [lang-expression]
[2022-10-21T16:30:33,963][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [lang-mustache]
[2022-10-21T16:30:33,963][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [lang-painless]
[2022-10-21T16:30:33,963][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [mapper-extras]
[2022-10-21T16:30:33,964][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [parent-join]
[2022-10-21T16:30:33,964][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [percolator]
[2022-10-21T16:30:33,964][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [rank-eval]
[2022-10-21T16:30:33,964][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [reindex]
[2022-10-21T16:30:33,964][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [repository-url]
[2022-10-21T16:30:33,965][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [tasks]
[2022-10-21T16:30:33,965][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded module [transport-netty4]
[2022-10-21T16:30:33,966][INFO ][o.e.p.PluginsService     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] loaded plugin [repository-s3]
[2022-10-21T16:30:34,014][INFO ][o.e.e.NodeEnvironment    ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] using [1] data paths, mounts [[/bitnami/elasticsearch/data (/dev/vda1)]], net usable_space [152.1gb], net total_space [154.8gb], types [ext4]
[2022-10-21T16:30:34,015][INFO ][o.e.e.NodeEnvironment    ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] heap size [123.7mb], compressed ordinary object pointers [true]
[2022-10-21T16:30:34,077][INFO ][o.e.n.Node               ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] node name [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n], node ID [ArQV6vwyTrGDZxUU9ocrjA], cluster name [sdnrdb-cluster]
[2022-10-21T16:30:38,182][INFO ][o.e.t.NettyAllocator     ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] creating NettyAllocator with the following configs: [name=unpooled, factors={es.unsafe.use_unpooled_allocator=false, g1gc_enabled=false, g1gc_region_size=0b, heap_size=123.7mb}]
[2022-10-21T16:30:38,263][INFO ][o.e.d.DiscoveryModule    ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] using discovery type [zen] and seed hosts providers [settings]
[2022-10-21T16:30:38,643][WARN ][o.e.g.DanglingIndicesState] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2022-10-21T16:30:38,822][INFO ][o.e.n.Node               ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] initialized
[2022-10-21T16:30:38,822][INFO ][o.e.n.Node               ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] starting ...
[2022-10-21T16:30:38,976][INFO ][o.e.t.TransportService   ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] publish_address {10.233.65.92:9300}, bound_addresses {0.0.0.0:9300}
[2022-10-21T16:30:39,234][INFO ][o.e.b.BootstrapChecks    ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2022-10-21T16:35:39,260][WARN ][o.e.n.Node               ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] timed out while waiting for initial discovery state - timeout: 5m
[2022-10-21T16:35:39,287][INFO ][o.e.h.AbstractHttpServerTransport] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] publish_address {10.233.65.92:9000}, bound_addresses {0.0.0.0:9000}
[2022-10-21T16:35:39,288][INFO ][o.e.n.Node               ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] started
[2022-10-21T16:37:37,101][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, added {{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr},{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2, reason: ApplyCommitRequest{term=2, version=2, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T16:38:03,426][INFO ][o.e.c.s.ClusterSettings  ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] updating [action.auto_create_index] from [true] to [false]
[2022-10-21T16:40:55,116][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 97, reason: ApplyCommitRequest{term=2, version=97, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T17:37:38,032][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-21T17:37:38,050][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 176, reason: becoming candidate: onLeaderFailure
[2022-10-21T17:37:38,265][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 178, reason: ApplyCommitRequest{term=2, version=178, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T17:39:35,111][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 179, reason: ApplyCommitRequest{term=2, version=179, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T17:39:38,602][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 180, reason: ApplyCommitRequest{term=2, version=180, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T17:39:39,144][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 181, reason: ApplyCommitRequest{term=2, version=181, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T17:39:40,217][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 182, reason: ApplyCommitRequest{term=2, version=182, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T17:42:24,040][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 250, reason: ApplyCommitRequest{term=2, version=250, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T17:42:26,663][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 251, reason: ApplyCommitRequest{term=2, version=251, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T17:42:29,512][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-21T17:42:29,515][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 252, reason: becoming candidate: onLeaderFailure
[2022-10-21T17:42:31,317][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 253, reason: ApplyCommitRequest{term=2, version=253, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T18:37:41,070][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-21T18:37:41,084][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 318, reason: becoming candidate: onLeaderFailure
[2022-10-21T18:37:41,193][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 320, reason: ApplyCommitRequest{term=2, version=320, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T18:39:41,325][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 321, reason: ApplyCommitRequest{term=2, version=321, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T18:39:44,084][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 322, reason: ApplyCommitRequest{term=2, version=322, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T18:39:44,666][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 323, reason: ApplyCommitRequest{term=2, version=323, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T18:39:45,418][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 324, reason: ApplyCommitRequest{term=2, version=324, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T18:42:27,159][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 396, reason: ApplyCommitRequest{term=2, version=396, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T18:42:29,531][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-21T18:42:29,533][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 396, reason: becoming candidate: onLeaderFailure
[2022-10-21T18:42:29,799][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 397, reason: ApplyCommitRequest{term=2, version=397, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T18:42:30,782][WARN ][o.e.d.HandshakingTransportAddressConnector] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] handshake failed for [connectToRemoteMasterNode[10.233.72.3:9300]]
org.elasticsearch.transport.ReceiveTimeoutTransportException: [][10.233.72.3:9300][internal:transport/handshake] request_id [8846] timed out after [1001ms]
	at org.elasticsearch.transport.TransportService$TimeoutHandler.run(TransportService.java:1074) [elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:678) [elasticsearch-7.9.3.jar:7.9.3]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
[2022-10-21T18:42:31,808][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 398, reason: ApplyCommitRequest{term=2, version=398, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T19:37:43,295][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-21T19:37:43,306][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 465, reason: becoming candidate: onLeaderFailure
[2022-10-21T19:37:43,407][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 467, reason: ApplyCommitRequest{term=2, version=467, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T19:39:47,036][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 468, reason: ApplyCommitRequest{term=2, version=468, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T19:39:49,318][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 469, reason: ApplyCommitRequest{term=2, version=469, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T19:39:49,721][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 470, reason: ApplyCommitRequest{term=2, version=470, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T19:39:50,395][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 471, reason: ApplyCommitRequest{term=2, version=471, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T19:42:29,560][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-21T19:42:29,565][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 539, reason: becoming candidate: onLeaderFailure
[2022-10-21T19:42:29,655][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 540, reason: ApplyCommitRequest{term=2, version=540, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T19:42:32,304][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 541, reason: ApplyCommitRequest{term=2, version=541, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T19:42:34,798][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 542, reason: ApplyCommitRequest{term=2, version=542, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T20:37:45,600][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-21T20:37:45,611][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 610, reason: becoming candidate: onLeaderFailure
[2022-10-21T20:37:45,849][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 612, reason: ApplyCommitRequest{term=2, version=612, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T20:39:51,210][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 613, reason: ApplyCommitRequest{term=2, version=613, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T20:39:53,860][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 614, reason: ApplyCommitRequest{term=2, version=614, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T20:39:54,370][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 615, reason: ApplyCommitRequest{term=2, version=615, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T20:39:54,812][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 616, reason: ApplyCommitRequest{term=2, version=616, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T20:42:29,571][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-21T20:42:29,576][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 685, reason: becoming candidate: onLeaderFailure
[2022-10-21T20:42:29,642][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 686, reason: ApplyCommitRequest{term=2, version=686, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T20:42:35,283][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 687, reason: ApplyCommitRequest{term=2, version=687, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T20:42:37,810][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 688, reason: ApplyCommitRequest{term=2, version=688, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T21:37:48,513][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-21T21:37:48,523][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 756, reason: becoming candidate: onLeaderFailure
[2022-10-21T21:37:48,606][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 758, reason: ApplyCommitRequest{term=2, version=758, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T21:39:56,782][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 759, reason: ApplyCommitRequest{term=2, version=759, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T21:39:59,556][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 760, reason: ApplyCommitRequest{term=2, version=760, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T21:40:00,229][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 761, reason: ApplyCommitRequest{term=2, version=761, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T21:40:00,646][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 762, reason: ApplyCommitRequest{term=2, version=762, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T21:42:29,585][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-21T21:42:29,588][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 831, reason: becoming candidate: onLeaderFailure
[2022-10-21T21:42:29,657][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 832, reason: ApplyCommitRequest{term=2, version=832, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T21:42:38,170][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 833, reason: ApplyCommitRequest{term=2, version=833, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T21:42:40,954][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 834, reason: ApplyCommitRequest{term=2, version=834, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T22:37:51,436][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-21T22:37:51,447][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 903, reason: becoming candidate: onLeaderFailure
[2022-10-21T22:37:51,787][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 905, reason: ApplyCommitRequest{term=2, version=905, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T22:40:02,574][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 906, reason: ApplyCommitRequest{term=2, version=906, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T22:40:04,517][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 907, reason: ApplyCommitRequest{term=2, version=907, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T22:40:04,939][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 908, reason: ApplyCommitRequest{term=2, version=908, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T22:40:05,762][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 909, reason: ApplyCommitRequest{term=2, version=909, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T22:42:29,599][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-21T22:42:29,605][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 977, reason: becoming candidate: onLeaderFailure
[2022-10-21T22:42:29,702][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 978, reason: ApplyCommitRequest{term=2, version=978, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T22:42:41,527][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 979, reason: ApplyCommitRequest{term=2, version=979, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T22:42:43,849][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 980, reason: ApplyCommitRequest{term=2, version=980, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T23:37:54,382][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-21T23:37:54,392][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1048, reason: becoming candidate: onLeaderFailure
[2022-10-21T23:37:54,481][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1050, reason: ApplyCommitRequest{term=2, version=1050, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T23:40:07,349][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1051, reason: ApplyCommitRequest{term=2, version=1051, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T23:40:09,706][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1052, reason: ApplyCommitRequest{term=2, version=1052, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T23:40:09,939][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1053, reason: ApplyCommitRequest{term=2, version=1053, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T23:40:10,942][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1054, reason: ApplyCommitRequest{term=2, version=1054, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T23:42:29,619][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-21T23:42:29,625][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1124, reason: becoming candidate: onLeaderFailure
[2022-10-21T23:42:29,747][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1125, reason: ApplyCommitRequest{term=2, version=1125, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T23:42:44,227][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1126, reason: ApplyCommitRequest{term=2, version=1126, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-21T23:42:46,551][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1127, reason: ApplyCommitRequest{term=2, version=1127, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T00:37:57,443][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T00:37:57,471][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1195, reason: becoming candidate: onLeaderFailure
[2022-10-22T00:37:57,565][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1197, reason: ApplyCommitRequest{term=2, version=1197, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T00:40:12,361][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1198, reason: ApplyCommitRequest{term=2, version=1198, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T00:40:15,456][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1199, reason: ApplyCommitRequest{term=2, version=1199, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T00:40:15,773][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1200, reason: ApplyCommitRequest{term=2, version=1200, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T00:40:16,427][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1201, reason: ApplyCommitRequest{term=2, version=1201, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T00:42:29,643][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T00:42:29,649][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1269, reason: becoming candidate: onLeaderFailure
[2022-10-22T00:42:29,793][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1270, reason: ApplyCommitRequest{term=2, version=1270, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T00:42:47,176][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1271, reason: ApplyCommitRequest{term=2, version=1271, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T00:42:49,335][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1272, reason: ApplyCommitRequest{term=2, version=1272, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:38:00,090][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T01:38:00,101][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1340, reason: becoming candidate: onLeaderFailure
[2022-10-22T01:38:00,187][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1342, reason: ApplyCommitRequest{term=2, version=1342, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:40:17,633][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1343, reason: ApplyCommitRequest{term=2, version=1343, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:40:19,809][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1344, reason: ApplyCommitRequest{term=2, version=1344, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:40:20,189][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1345, reason: ApplyCommitRequest{term=2, version=1345, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:40:20,296][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1346, reason: ApplyCommitRequest{term=2, version=1346, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:40:20,427][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1347, reason: ApplyCommitRequest{term=2, version=1347, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:40:21,196][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1348, reason: ApplyCommitRequest{term=2, version=1348, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:42:29,656][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T01:42:29,659][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1417, reason: becoming candidate: onLeaderFailure
[2022-10-22T01:42:29,809][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1418, reason: ApplyCommitRequest{term=2, version=1418, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:42:50,686][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1419, reason: ApplyCommitRequest{term=2, version=1419, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:42:53,580][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1420, reason: ApplyCommitRequest{term=2, version=1420, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:42:53,842][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1421, reason: ApplyCommitRequest{term=2, version=1421, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T01:42:54,098][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1422, reason: ApplyCommitRequest{term=2, version=1422, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T02:38:03,085][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T02:38:03,096][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1489, reason: becoming candidate: onLeaderFailure
[2022-10-22T02:38:03,226][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1491, reason: ApplyCommitRequest{term=2, version=1491, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T02:40:21,923][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1492, reason: ApplyCommitRequest{term=2, version=1492, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T02:40:24,524][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1493, reason: ApplyCommitRequest{term=2, version=1493, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T02:42:29,673][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T02:42:29,678][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1561, reason: becoming candidate: onLeaderFailure
[2022-10-22T02:42:29,742][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1562, reason: ApplyCommitRequest{term=2, version=1562, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T02:42:54,714][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1563, reason: ApplyCommitRequest{term=2, version=1563, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T02:42:56,492][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1564, reason: ApplyCommitRequest{term=2, version=1564, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T03:38:05,810][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T03:38:05,822][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1632, reason: becoming candidate: onLeaderFailure
[2022-10-22T03:38:05,932][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1634, reason: ApplyCommitRequest{term=2, version=1634, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T03:40:25,528][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1635, reason: ApplyCommitRequest{term=2, version=1635, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T03:40:27,650][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1636, reason: ApplyCommitRequest{term=2, version=1636, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T03:40:27,948][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1637, reason: ApplyCommitRequest{term=2, version=1637, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T03:40:28,553][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1638, reason: ApplyCommitRequest{term=2, version=1638, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T03:42:29,690][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T03:42:29,693][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1704, reason: becoming candidate: onLeaderFailure
[2022-10-22T03:42:29,766][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1705, reason: ApplyCommitRequest{term=2, version=1705, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T03:42:57,088][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1706, reason: ApplyCommitRequest{term=2, version=1706, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T03:42:59,683][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1707, reason: ApplyCommitRequest{term=2, version=1707, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T04:38:08,415][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T04:38:08,425][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1773, reason: becoming candidate: onLeaderFailure
[2022-10-22T04:38:08,526][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1775, reason: ApplyCommitRequest{term=2, version=1775, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T04:40:29,732][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1776, reason: ApplyCommitRequest{term=2, version=1776, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T04:40:33,036][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1777, reason: ApplyCommitRequest{term=2, version=1777, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T04:40:33,196][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1778, reason: ApplyCommitRequest{term=2, version=1778, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T04:40:33,557][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1779, reason: ApplyCommitRequest{term=2, version=1779, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T04:42:29,702][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T04:42:29,704][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1847, reason: becoming candidate: onLeaderFailure
[2022-10-22T04:42:29,817][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1848, reason: ApplyCommitRequest{term=2, version=1848, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T04:43:00,584][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1849, reason: ApplyCommitRequest{term=2, version=1849, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T04:43:01,980][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1850, reason: ApplyCommitRequest{term=2, version=1850, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T05:38:11,408][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T05:38:11,422][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1918, reason: becoming candidate: onLeaderFailure
[2022-10-22T05:38:11,529][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1920, reason: ApplyCommitRequest{term=2, version=1920, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T05:40:34,830][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1921, reason: ApplyCommitRequest{term=2, version=1921, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T05:40:37,455][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1922, reason: ApplyCommitRequest{term=2, version=1922, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T05:40:37,746][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1923, reason: ApplyCommitRequest{term=2, version=1923, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T05:40:38,615][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 1924, reason: ApplyCommitRequest{term=2, version=1924, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T05:42:29,718][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T05:42:29,721][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 1991, reason: becoming candidate: onLeaderFailure
[2022-10-22T05:42:29,933][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 1992, reason: ApplyCommitRequest{term=2, version=1992, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T05:43:02,625][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1993, reason: ApplyCommitRequest{term=2, version=1993, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T05:43:04,385][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 1994, reason: ApplyCommitRequest{term=2, version=1994, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T06:38:13,534][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T06:38:13,545][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 2062, reason: becoming candidate: onLeaderFailure
[2022-10-22T06:38:13,623][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 2064, reason: ApplyCommitRequest{term=2, version=2064, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T06:40:39,653][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2065, reason: ApplyCommitRequest{term=2, version=2065, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T06:40:41,744][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2066, reason: ApplyCommitRequest{term=2, version=2066, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T06:40:42,134][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2067, reason: ApplyCommitRequest{term=2, version=2067, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T06:40:42,650][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2068, reason: ApplyCommitRequest{term=2, version=2068, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T06:42:29,728][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T06:42:29,735][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 2135, reason: becoming candidate: onLeaderFailure
[2022-10-22T06:42:29,887][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 2136, reason: ApplyCommitRequest{term=2, version=2136, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T06:43:04,936][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 2137, reason: ApplyCommitRequest{term=2, version=2137, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T06:43:07,223][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 2138, reason: ApplyCommitRequest{term=2, version=2138, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:38:16,567][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T07:38:16,580][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 2205, reason: becoming candidate: onLeaderFailure
[2022-10-22T07:38:16,675][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 2207, reason: ApplyCommitRequest{term=2, version=2207, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:40:43,870][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2208, reason: ApplyCommitRequest{term=2, version=2208, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:40:46,074][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2209, reason: ApplyCommitRequest{term=2, version=2209, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:40:47,255][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2210, reason: ApplyCommitRequest{term=2, version=2210, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:40:47,786][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2211, reason: ApplyCommitRequest{term=2, version=2211, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:42:29,750][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T07:42:29,757][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 2280, reason: becoming candidate: onLeaderFailure
[2022-10-22T07:42:30,005][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 2281, reason: ApplyCommitRequest{term=2, version=2281, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:43:08,379][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 2282, reason: ApplyCommitRequest{term=2, version=2282, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:43:10,382][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 2283, reason: ApplyCommitRequest{term=2, version=2283, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:43:10,785][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 2284, reason: ApplyCommitRequest{term=2, version=2284, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:43:11,080][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 2285, reason: ApplyCommitRequest{term=2, version=2285, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:43:11,386][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 2286, reason: ApplyCommitRequest{term=2, version=2286, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T07:43:11,814][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 2287, reason: ApplyCommitRequest{term=2, version=2287, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T08:38:19,625][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T08:38:19,632][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 2354, reason: becoming candidate: onLeaderFailure
[2022-10-22T08:38:19,906][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 2356, reason: ApplyCommitRequest{term=2, version=2356, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T08:40:50,764][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2357, reason: ApplyCommitRequest{term=2, version=2357, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T08:40:52,570][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2358, reason: ApplyCommitRequest{term=2, version=2358, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T08:40:52,799][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2359, reason: ApplyCommitRequest{term=2, version=2359, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T08:40:52,881][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2360, reason: ApplyCommitRequest{term=2, version=2360, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T08:40:53,039][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2361, reason: ApplyCommitRequest{term=2, version=2361, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T08:40:53,779][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2362, reason: ApplyCommitRequest{term=2, version=2362, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T08:42:29,774][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T08:42:29,778][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 2432, reason: becoming candidate: onLeaderFailure
[2022-10-22T08:42:29,854][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 2433, reason: ApplyCommitRequest{term=2, version=2433, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T08:43:12,765][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 2434, reason: ApplyCommitRequest{term=2, version=2434, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T08:43:15,302][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 2, version: 2435, reason: ApplyCommitRequest{term=2, version=2435, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T09:38:22,242][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T09:38:22,252][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 2504, reason: becoming candidate: onLeaderFailure
[2022-10-22T09:38:22,325][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 2, version: 2506, reason: ApplyCommitRequest{term=2, version=2506, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T09:40:55,145][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 2, version: 2507, reason: ApplyCommitRequest{term=2, version=2507, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T09:40:57,541][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 2, version: 2507, reason: becoming candidate: joinLeaderInTerm
[2022-10-22T09:40:57,887][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 2508, reason: ApplyCommitRequest{term=4, version=2508, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T09:42:29,790][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T09:42:29,793][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 2578, reason: becoming candidate: onLeaderFailure
[2022-10-22T09:42:29,962][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 2579, reason: ApplyCommitRequest{term=4, version=2579, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T09:43:15,426][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 2580, reason: ApplyCommitRequest{term=4, version=2580, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T09:43:18,089][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 2581, reason: ApplyCommitRequest{term=4, version=2581, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T10:38:24,328][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T10:38:24,337][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 2649, reason: becoming candidate: onLeaderFailure
[2022-10-22T10:38:24,438][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 2651, reason: ApplyCommitRequest{term=4, version=2651, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T10:40:58,221][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 2653, reason: ApplyCommitRequest{term=4, version=2653, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T10:41:01,063][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 2654, reason: ApplyCommitRequest{term=4, version=2654, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T10:41:01,553][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 2655, reason: ApplyCommitRequest{term=4, version=2655, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T10:41:01,798][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 2656, reason: ApplyCommitRequest{term=4, version=2656, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T10:42:29,811][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T10:42:29,814][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 2721, reason: becoming candidate: onLeaderFailure
[2022-10-22T10:42:29,886][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 2722, reason: ApplyCommitRequest{term=4, version=2722, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T10:43:19,387][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 2723, reason: ApplyCommitRequest{term=4, version=2723, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T10:43:20,776][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 2724, reason: ApplyCommitRequest{term=4, version=2724, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T11:38:27,319][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T11:38:27,327][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 2791, reason: becoming candidate: onLeaderFailure
[2022-10-22T11:38:27,412][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 2793, reason: ApplyCommitRequest{term=4, version=2793, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T11:41:02,875][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 2795, reason: ApplyCommitRequest{term=4, version=2795, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T11:41:06,231][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 2796, reason: ApplyCommitRequest{term=4, version=2796, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T11:41:06,422][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 2797, reason: ApplyCommitRequest{term=4, version=2797, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T11:41:06,898][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 2798, reason: ApplyCommitRequest{term=4, version=2798, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T11:42:29,827][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T11:42:29,836][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 2865, reason: becoming candidate: onLeaderFailure
[2022-10-22T11:42:29,901][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 2866, reason: ApplyCommitRequest{term=4, version=2866, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T11:43:21,165][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 2867, reason: ApplyCommitRequest{term=4, version=2867, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T11:43:23,912][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 2868, reason: ApplyCommitRequest{term=4, version=2868, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T12:38:30,160][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T12:38:30,169][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 2935, reason: becoming candidate: onLeaderFailure
[2022-10-22T12:38:30,340][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 2937, reason: ApplyCommitRequest{term=4, version=2937, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T12:41:07,767][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 2939, reason: ApplyCommitRequest{term=4, version=2939, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T12:41:09,927][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 2940, reason: ApplyCommitRequest{term=4, version=2940, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T12:42:29,847][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T12:42:29,852][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3008, reason: becoming candidate: onLeaderFailure
[2022-10-22T12:42:29,920][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3009, reason: ApplyCommitRequest{term=4, version=3009, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T12:43:24,377][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3010, reason: ApplyCommitRequest{term=4, version=3010, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T12:43:27,055][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3011, reason: ApplyCommitRequest{term=4, version=3011, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T13:38:32,998][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T13:38:33,007][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3079, reason: becoming candidate: onLeaderFailure
[2022-10-22T13:38:33,144][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3081, reason: ApplyCommitRequest{term=4, version=3081, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T13:41:11,100][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3083, reason: ApplyCommitRequest{term=4, version=3083, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T13:41:14,408][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3084, reason: ApplyCommitRequest{term=4, version=3084, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T13:41:14,699][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3085, reason: ApplyCommitRequest{term=4, version=3085, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T13:41:15,027][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3086, reason: ApplyCommitRequest{term=4, version=3086, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T13:42:29,863][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T13:42:29,867][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3152, reason: becoming candidate: onLeaderFailure
[2022-10-22T13:42:29,950][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3153, reason: ApplyCommitRequest{term=4, version=3153, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T13:43:28,172][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3154, reason: ApplyCommitRequest{term=4, version=3154, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T13:43:29,773][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3155, reason: ApplyCommitRequest{term=4, version=3155, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T14:38:35,961][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T14:38:35,969][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3222, reason: becoming candidate: onLeaderFailure
[2022-10-22T14:38:36,049][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3224, reason: ApplyCommitRequest{term=4, version=3224, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T14:41:15,936][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3226, reason: ApplyCommitRequest{term=4, version=3226, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T14:41:18,956][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3227, reason: ApplyCommitRequest{term=4, version=3227, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T14:41:19,114][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3228, reason: ApplyCommitRequest{term=4, version=3228, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T14:41:20,146][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3229, reason: ApplyCommitRequest{term=4, version=3229, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T14:42:29,877][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T14:42:29,883][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3298, reason: becoming candidate: onLeaderFailure
[2022-10-22T14:42:30,013][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3299, reason: ApplyCommitRequest{term=4, version=3299, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T14:43:30,361][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3300, reason: ApplyCommitRequest{term=4, version=3300, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T14:43:32,412][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3301, reason: ApplyCommitRequest{term=4, version=3301, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T15:38:38,595][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T15:38:38,605][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3368, reason: becoming candidate: onLeaderFailure
[2022-10-22T15:38:38,723][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3370, reason: ApplyCommitRequest{term=4, version=3370, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T15:41:21,102][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3372, reason: ApplyCommitRequest{term=4, version=3372, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T15:41:24,778][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3373, reason: ApplyCommitRequest{term=4, version=3373, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T15:41:25,190][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3374, reason: ApplyCommitRequest{term=4, version=3374, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T15:41:26,211][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3375, reason: ApplyCommitRequest{term=4, version=3375, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T15:42:29,894][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T15:42:29,900][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3441, reason: becoming candidate: onLeaderFailure
[2022-10-22T15:42:29,966][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3442, reason: ApplyCommitRequest{term=4, version=3442, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T15:43:32,811][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3443, reason: ApplyCommitRequest{term=4, version=3443, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T15:43:35,095][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3444, reason: ApplyCommitRequest{term=4, version=3444, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T16:38:41,197][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T16:38:41,205][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3512, reason: becoming candidate: onLeaderFailure
[2022-10-22T16:38:41,285][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3514, reason: ApplyCommitRequest{term=4, version=3514, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T16:41:26,848][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3516, reason: ApplyCommitRequest{term=4, version=3516, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T16:41:28,276][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3517, reason: ApplyCommitRequest{term=4, version=3517, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T16:42:29,909][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T16:42:29,912][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3582, reason: becoming candidate: onLeaderFailure
[2022-10-22T16:42:29,984][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3583, reason: ApplyCommitRequest{term=4, version=3583, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T16:43:35,597][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3584, reason: ApplyCommitRequest{term=4, version=3584, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T16:43:38,185][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3585, reason: ApplyCommitRequest{term=4, version=3585, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T17:38:43,645][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T17:38:43,653][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3653, reason: becoming candidate: onLeaderFailure
[2022-10-22T17:38:43,732][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3655, reason: ApplyCommitRequest{term=4, version=3655, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T17:41:28,901][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3657, reason: ApplyCommitRequest{term=4, version=3657, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T17:41:31,507][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3658, reason: ApplyCommitRequest{term=4, version=3658, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T17:42:29,926][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T17:42:29,930][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3724, reason: becoming candidate: onLeaderFailure
[2022-10-22T17:42:30,000][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3725, reason: ApplyCommitRequest{term=4, version=3725, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T17:43:38,693][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3726, reason: ApplyCommitRequest{term=4, version=3726, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T17:43:40,771][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3727, reason: ApplyCommitRequest{term=4, version=3727, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T18:38:46,680][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T18:38:46,689][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3794, reason: becoming candidate: onLeaderFailure
[2022-10-22T18:38:46,844][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3796, reason: ApplyCommitRequest{term=4, version=3796, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T18:41:32,370][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3798, reason: ApplyCommitRequest{term=4, version=3798, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T18:41:34,062][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3799, reason: ApplyCommitRequest{term=4, version=3799, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T18:42:29,941][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T18:42:29,944][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3865, reason: becoming candidate: onLeaderFailure
[2022-10-22T18:42:30,019][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3866, reason: ApplyCommitRequest{term=4, version=3866, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T18:43:41,089][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3867, reason: ApplyCommitRequest{term=4, version=3867, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T18:43:43,259][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 3868, reason: ApplyCommitRequest{term=4, version=3868, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T19:38:49,706][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T19:38:49,716][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 3936, reason: becoming candidate: onLeaderFailure
[2022-10-22T19:38:49,800][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 3938, reason: ApplyCommitRequest{term=4, version=3938, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T19:41:34,570][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3940, reason: ApplyCommitRequest{term=4, version=3940, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T19:41:36,524][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3941, reason: ApplyCommitRequest{term=4, version=3941, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T19:41:36,626][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3942, reason: ApplyCommitRequest{term=4, version=3942, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T19:41:37,158][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 3943, reason: ApplyCommitRequest{term=4, version=3943, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T19:42:29,960][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T19:42:29,966][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4013, reason: becoming candidate: onLeaderFailure
[2022-10-22T19:42:30,031][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4014, reason: ApplyCommitRequest{term=4, version=4014, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T19:43:43,677][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4015, reason: ApplyCommitRequest{term=4, version=4015, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T19:43:46,506][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4016, reason: ApplyCommitRequest{term=4, version=4016, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T20:38:51,893][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T20:38:51,909][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4083, reason: becoming candidate: onLeaderFailure
[2022-10-22T20:38:52,203][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4085, reason: ApplyCommitRequest{term=4, version=4085, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T20:41:38,137][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4087, reason: ApplyCommitRequest{term=4, version=4087, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T20:41:40,501][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4088, reason: ApplyCommitRequest{term=4, version=4088, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T20:41:40,622][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4089, reason: ApplyCommitRequest{term=4, version=4089, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T20:41:41,097][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4090, reason: ApplyCommitRequest{term=4, version=4090, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T20:42:29,978][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T20:42:29,983][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4156, reason: becoming candidate: onLeaderFailure
[2022-10-22T20:42:30,048][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4157, reason: ApplyCommitRequest{term=4, version=4157, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T20:43:46,794][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4158, reason: ApplyCommitRequest{term=4, version=4158, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T20:43:49,825][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4159, reason: ApplyCommitRequest{term=4, version=4159, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T21:38:54,752][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T21:38:54,763][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4227, reason: becoming candidate: onLeaderFailure
[2022-10-22T21:38:54,855][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4229, reason: ApplyCommitRequest{term=4, version=4229, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T21:41:42,787][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4231, reason: ApplyCommitRequest{term=4, version=4231, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T21:41:44,213][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4232, reason: ApplyCommitRequest{term=4, version=4232, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T21:41:44,394][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4233, reason: ApplyCommitRequest{term=4, version=4233, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T21:41:45,250][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4234, reason: ApplyCommitRequest{term=4, version=4234, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T21:42:29,993][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T21:42:29,999][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4302, reason: becoming candidate: onLeaderFailure
[2022-10-22T21:42:30,073][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4303, reason: ApplyCommitRequest{term=4, version=4303, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T21:43:50,241][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4304, reason: ApplyCommitRequest{term=4, version=4304, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T21:43:52,519][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4305, reason: ApplyCommitRequest{term=4, version=4305, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T22:38:57,797][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T22:38:57,808][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4372, reason: becoming candidate: onLeaderFailure
[2022-10-22T22:38:57,886][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4374, reason: ApplyCommitRequest{term=4, version=4374, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T22:41:46,695][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4376, reason: ApplyCommitRequest{term=4, version=4376, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T22:41:49,070][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4377, reason: ApplyCommitRequest{term=4, version=4377, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T22:41:49,167][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4378, reason: ApplyCommitRequest{term=4, version=4378, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T22:41:49,257][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4379, reason: ApplyCommitRequest{term=4, version=4379, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T22:42:30,004][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T22:42:30,007][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4446, reason: becoming candidate: onLeaderFailure
[2022-10-22T22:42:30,074][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4447, reason: ApplyCommitRequest{term=4, version=4447, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T22:43:53,561][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4448, reason: ApplyCommitRequest{term=4, version=4448, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T22:43:55,558][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4449, reason: ApplyCommitRequest{term=4, version=4449, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T23:39:00,720][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-22T23:39:00,731][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4517, reason: becoming candidate: onLeaderFailure
[2022-10-22T23:39:00,806][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4519, reason: ApplyCommitRequest{term=4, version=4519, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T23:41:50,037][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4521, reason: ApplyCommitRequest{term=4, version=4521, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T23:41:52,211][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4522, reason: ApplyCommitRequest{term=4, version=4522, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T23:42:30,021][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-22T23:42:30,024][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4588, reason: becoming candidate: onLeaderFailure
[2022-10-22T23:42:30,082][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4589, reason: ApplyCommitRequest{term=4, version=4589, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T23:43:56,290][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4590, reason: ApplyCommitRequest{term=4, version=4590, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-22T23:43:57,886][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4591, reason: ApplyCommitRequest{term=4, version=4591, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T00:39:02,825][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-23T00:39:02,837][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4658, reason: becoming candidate: onLeaderFailure
[2022-10-23T00:39:02,916][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4660, reason: ApplyCommitRequest{term=4, version=4660, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T00:41:54,191][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4662, reason: ApplyCommitRequest{term=4, version=4662, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T00:41:55,647][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4663, reason: ApplyCommitRequest{term=4, version=4663, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T00:41:55,829][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4664, reason: ApplyCommitRequest{term=4, version=4664, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T00:41:56,181][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4665, reason: ApplyCommitRequest{term=4, version=4665, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T00:42:30,036][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-23T00:42:30,040][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4734, reason: becoming candidate: onLeaderFailure
[2022-10-23T00:42:30,126][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4735, reason: ApplyCommitRequest{term=4, version=4735, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T00:43:58,248][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4736, reason: ApplyCommitRequest{term=4, version=4736, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T00:44:00,866][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4737, reason: ApplyCommitRequest{term=4, version=4737, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T01:39:05,734][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-23T01:39:05,742][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4804, reason: becoming candidate: onLeaderFailure
[2022-10-23T01:39:05,824][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4806, reason: ApplyCommitRequest{term=4, version=4806, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T01:41:57,054][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4808, reason: ApplyCommitRequest{term=4, version=4808, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T01:41:58,747][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4809, reason: ApplyCommitRequest{term=4, version=4809, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T01:41:58,874][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4810, reason: ApplyCommitRequest{term=4, version=4810, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T01:41:59,360][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4811, reason: ApplyCommitRequest{term=4, version=4811, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T01:42:30,058][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-23T01:42:30,075][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4878, reason: becoming candidate: onLeaderFailure
[2022-10-23T01:42:30,198][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4879, reason: ApplyCommitRequest{term=4, version=4879, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T01:44:01,855][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4880, reason: ApplyCommitRequest{term=4, version=4880, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T01:44:03,599][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 4881, reason: ApplyCommitRequest{term=4, version=4881, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T02:39:07,859][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-23T02:39:07,871][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 4948, reason: becoming candidate: onLeaderFailure
[2022-10-23T02:39:07,957][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 4950, reason: ApplyCommitRequest{term=4, version=4950, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T02:42:00,025][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4952, reason: ApplyCommitRequest{term=4, version=4952, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T02:42:03,579][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4953, reason: ApplyCommitRequest{term=4, version=4953, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T02:42:03,885][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4954, reason: ApplyCommitRequest{term=4, version=4954, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T02:42:04,585][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 4955, reason: ApplyCommitRequest{term=4, version=4955, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T02:42:30,091][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-23T02:42:30,096][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 5022, reason: becoming candidate: onLeaderFailure
[2022-10-23T02:42:30,201][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 5023, reason: ApplyCommitRequest{term=4, version=5023, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T02:44:03,927][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 5024, reason: ApplyCommitRequest{term=4, version=5024, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T02:44:06,901][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 5025, reason: ApplyCommitRequest{term=4, version=5025, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T03:39:10,853][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-23T03:39:10,863][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 5092, reason: becoming candidate: onLeaderFailure
[2022-10-23T03:39:10,948][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 5094, reason: ApplyCommitRequest{term=4, version=5094, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T03:42:05,474][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5096, reason: ApplyCommitRequest{term=4, version=5096, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T03:42:07,522][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5097, reason: ApplyCommitRequest{term=4, version=5097, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T03:42:30,109][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-23T03:42:30,113][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 5166, reason: becoming candidate: onLeaderFailure
[2022-10-23T03:42:30,406][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 5167, reason: ApplyCommitRequest{term=4, version=5167, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T03:44:07,269][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 5168, reason: ApplyCommitRequest{term=4, version=5168, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T03:44:09,129][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 5169, reason: ApplyCommitRequest{term=4, version=5169, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T04:39:13,858][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-23T04:39:13,869][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 5235, reason: becoming candidate: onLeaderFailure
[2022-10-23T04:39:13,955][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 5237, reason: ApplyCommitRequest{term=4, version=5237, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T04:42:08,942][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5239, reason: ApplyCommitRequest{term=4, version=5239, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T04:42:12,107][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5240, reason: ApplyCommitRequest{term=4, version=5240, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T04:42:12,669][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5241, reason: ApplyCommitRequest{term=4, version=5241, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T04:42:13,421][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5242, reason: ApplyCommitRequest{term=4, version=5242, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T04:42:30,120][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-23T04:42:30,130][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 5278, reason: becoming candidate: onLeaderFailure
[2022-10-23T04:42:30,301][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 5280, reason: ApplyCommitRequest{term=4, version=5280, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T04:44:09,617][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 5309, reason: ApplyCommitRequest{term=4, version=5309, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T04:44:12,114][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 5310, reason: ApplyCommitRequest{term=4, version=5310, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T05:39:16,528][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-23T05:39:16,540][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 5379, reason: becoming candidate: onLeaderFailure
[2022-10-23T05:39:16,688][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 5381, reason: ApplyCommitRequest{term=4, version=5381, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T05:42:14,179][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5383, reason: ApplyCommitRequest{term=4, version=5383, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T05:42:17,423][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5384, reason: ApplyCommitRequest{term=4, version=5384, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T05:42:17,669][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5385, reason: ApplyCommitRequest{term=4, version=5385, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T05:42:18,461][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5386, reason: ApplyCommitRequest{term=4, version=5386, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T05:42:30,155][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-23T05:42:30,158][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 5427, reason: becoming candidate: onLeaderFailure
[2022-10-23T05:42:30,230][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 5428, reason: ApplyCommitRequest{term=4, version=5428, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T05:44:12,430][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 5456, reason: ApplyCommitRequest{term=4, version=5456, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T05:44:15,204][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 5457, reason: ApplyCommitRequest{term=4, version=5457, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T06:39:18,818][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) ~[?:?]
[2022-10-23T06:39:18,830][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 5524, reason: becoming candidate: onLeaderFailure
[2022-10-23T06:39:18,915][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 5526, reason: ApplyCommitRequest{term=4, version=5526, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T06:42:19,411][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5528, reason: ApplyCommitRequest{term=4, version=5528, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T06:42:21,615][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-2}{cw5gkwLgTJ-4oVhsYEyq8A}{n2eOhoyZT36xLcYb_2ztww}{10.233.65.112}{10.233.65.112:9300}{dmr}}, term: 4, version: 5529, reason: ApplyCommitRequest{term=4, version=5529, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T06:42:30,178][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.67.117:9300][disconnected] disconnected
[2022-10-23T06:42:30,182][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}], current []}, term: 4, version: 5554, reason: becoming candidate: onLeaderFailure
[2022-10-23T06:42:30,279][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node changed {previous [], current [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}]}, term: 4, version: 5555, reason: ApplyCommitRequest{term=4, version=5555, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T06:44:15,994][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] removed {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 5597, reason: ApplyCommitRequest{term=4, version=5597, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T06:44:18,490][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] added {{onap-sdnrdb-master-1}{smPDS3xtShGp5xZr0iCmrQ}{9jo_J_BbR3mPIqO4BUhzAg}{10.233.72.3}{10.233.72.3:9300}{dmr}}, term: 4, version: 5598, reason: ApplyCommitRequest{term=4, version=5598, sourceNode={onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}}
[2022-10-23T07:39:21,431][INFO ][o.e.c.c.Coordinator      ] [onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n] master node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed, restarting discovery
org.elasticsearch.ElasticsearchException: node [{onap-sdnrdb-master-0}{0N0iZdQhS8CqWzQH9aUJWg}{bHRG2dFiQd-ypxG9O_64LA}{10.233.67.117}{10.233.67.117:9300}{dmr}] failed [3] consecutive checks
	at org.elasticsearch.cluster.coordination.LeaderChecker$CheckScheduler$1.handleException(LeaderChecker.java:293) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TransportService$ContextRestoreResponseHandler.handleException(TransportService.java:1172) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.lambda$handleException$2(InboundHandler.java:235) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleException(InboundHandler.java:233) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handlerResponseError(InboundHandler.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:115) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[?:?]
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[?:?]
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[?:?]
	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) ~[?:?]
	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) ~[?:?]
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[?:?]
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[?:?]
	at java.lang.Thread.run(Thread.java:834) [?:?]
Caused by: org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.67.117:9300][internal:coordination/fault_detection/leader_check]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: rejecting leader check since [{onap-sdnrdb-coordinating-only-7c4fc6d7fd-dzh8n}{ArQV6vwyTrGDZxUU9ocrjA}{imb0xrgpS9aD1VhIhi6_Pg}{10.233.65.92}{10.233.65.92:9300}{r}] has been removed from the cluster
	at org.elasticsearch.cluster.coordination.LeaderChecker.handleLeaderCheck(LeaderChecker.java:192) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.cluster.coordination.LeaderChecker.lambda$new$0(LeaderChecker.java:113) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.common.util.concurrent.EsExecutors$DirectExecutorService.execute(EsExecutors.java:226) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:176) ~[elasticsearch-7.9.3.jar:7.9.3]
	at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[e