By type
[38;5;6m [38;5;5m03:01:19.01 [0m
[38;5;6m [38;5;5m03:01:19.02 [0m[1mWelcome to the Bitnami elasticsearch container[0m
[38;5;6m [38;5;5m03:01:19.02 [0mSubscribe to project updates by watching [1mhttps://github.com/bitnami/bitnami-docker-elasticsearch[0m
[38;5;6m [38;5;5m03:01:19.03 [0mSubmit issues and feature requests at [1mhttps://github.com/bitnami/bitnami-docker-elasticsearch/issues[0m
[38;5;6m [38;5;5m03:01:19.12 [0m
[38;5;6m [38;5;5m03:01:19.20 [0m[38;5;2mINFO [0m ==> ** Starting Elasticsearch setup **
[38;5;6m [38;5;5m03:01:19.53 [0m[38;5;2mINFO [0m ==> Configuring/Initializing Elasticsearch...
[38;5;6m [38;5;5m03:01:19.96 [0m[38;5;2mINFO [0m ==> Setting default configuration
[38;5;6m [38;5;5m03:01:20.03 [0m[38;5;2mINFO [0m ==> Configuring Elasticsearch cluster settings...
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[38;5;6m [38;5;5m03:01:41.02 [0m[38;5;2mINFO [0m ==> ** Elasticsearch setup finished! **
[38;5;6m [38;5;5m03:01:41.32 [0m[38;5;2mINFO [0m ==> ** Starting Elasticsearch **
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[2023-04-15T03:02:27,818][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] version[7.9.3], pid[1], build[oss/tar/c4138e51121ef06a6404866cddc601906fe5c868/2020-10-16T10:36:16.141335Z], OS[Linux/5.4.0-96-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/11.0.9/11.0.9+11-LTS]
[2023-04-15T03:02:27,912][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] JVM home [/opt/bitnami/java]
[2023-04-15T03:02:27,913][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms128m, -Xmx128m, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Djava.io.tmpdir=/tmp/elasticsearch-17382183406061154880, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=67108864, -Des.path.home=/opt/bitnami/elasticsearch, -Des.path.conf=/opt/bitnami/elasticsearch/config, -Des.distribution.flavor=oss, -Des.distribution.type=tar, -Des.bundled_jdk=true]
[2023-04-15T03:02:51,814][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [aggs-matrix-stats]
[2023-04-15T03:02:51,816][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [analysis-common]
[2023-04-15T03:02:51,817][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [geo]
[2023-04-15T03:02:51,818][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [ingest-common]
[2023-04-15T03:02:51,908][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [ingest-geoip]
[2023-04-15T03:02:51,909][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [ingest-user-agent]
[2023-04-15T03:02:51,909][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [kibana]
[2023-04-15T03:02:51,910][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [lang-expression]
[2023-04-15T03:02:51,910][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [lang-mustache]
[2023-04-15T03:02:51,911][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [lang-painless]
[2023-04-15T03:02:51,911][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [mapper-extras]
[2023-04-15T03:02:51,912][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [parent-join]
[2023-04-15T03:02:51,912][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [percolator]
[2023-04-15T03:02:51,912][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [rank-eval]
[2023-04-15T03:02:51,913][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [reindex]
[2023-04-15T03:02:51,913][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [repository-url]
[2023-04-15T03:02:51,914][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [tasks]
[2023-04-15T03:02:51,914][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [transport-netty4]
[2023-04-15T03:02:51,915][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded plugin [repository-s3]
[2023-04-15T03:02:53,124][INFO ][o.e.e.NodeEnvironment ] [onap-sdnrdb-master-0] using [1] data paths, mounts [[/bitnami/elasticsearch/data (192.168.5.136:/dockerdata-nfs/onap/elastic-master-0)]], net usable_space [95.6gb], net total_space [99.9gb], types [nfs4]
[2023-04-15T03:02:53,125][INFO ][o.e.e.NodeEnvironment ] [onap-sdnrdb-master-0] heap size [123.7mb], compressed ordinary object pointers [true]
[2023-04-15T03:02:54,019][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] node name [onap-sdnrdb-master-0], node ID [F6fQxZJCQGu52Rg-kw5Agg], cluster name [sdnrdb-cluster]
[2023-04-15T03:03:56,612][INFO ][o.e.t.NettyAllocator ] [onap-sdnrdb-master-0] creating NettyAllocator with the following configs: [name=unpooled, factors={es.unsafe.use_unpooled_allocator=false, g1gc_enabled=false, g1gc_region_size=0b, heap_size=123.7mb}]
[2023-04-15T03:03:57,915][INFO ][o.e.d.DiscoveryModule ] [onap-sdnrdb-master-0] using discovery type [zen] and seed hosts providers [settings]
[2023-04-15T03:04:04,215][WARN ][o.e.g.DanglingIndicesState] [onap-sdnrdb-master-0] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2023-04-15T03:04:07,216][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] initialized
[2023-04-15T03:04:07,217][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] starting ...
[2023-04-15T03:04:10,111][INFO ][o.e.t.TransportService ] [onap-sdnrdb-master-0] publish_address {10.233.71.139:9300}, bound_addresses {0.0.0.0:9300}
[2023-04-15T03:04:11,717][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-0] exception caught on transport layer [Netty4TcpChannel{localAddress=/10.233.71.139:9300, remoteAddress=/127.0.0.6:60231}], closing connection
java.lang.IllegalStateException: transport not ready yet to handle incoming requests
at org.elasticsearch.transport.TransportService.onRequestReceived(TransportService.java:943) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:136) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) [transport-netty4-client-7.9.3.jar:7.9.3]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) [netty-handler-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-04-15T03:04:12,611][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-0] exception caught on transport layer [Netty4TcpChannel{localAddress=/10.233.71.139:9300, remoteAddress=/127.0.0.6:55613}], closing connection
java.lang.IllegalStateException: transport not ready yet to handle incoming requests
at org.elasticsearch.transport.TransportService.onRequestReceived(TransportService.java:943) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:136) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) [transport-netty4-client-7.9.3.jar:7.9.3]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) [netty-handler-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-04-15T03:04:13,615][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-0] exception caught on transport layer [Netty4TcpChannel{localAddress=/10.233.71.139:9300, remoteAddress=/127.0.0.6:54739}], closing connection
java.lang.IllegalStateException: transport not ready yet to handle incoming requests
at org.elasticsearch.transport.TransportService.onRequestReceived(TransportService.java:943) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:136) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) [transport-netty4-client-7.9.3.jar:7.9.3]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) [netty-handler-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-04-15T03:04:13,710][INFO ][o.e.m.j.JvmGcMonitorService] [onap-sdnrdb-master-0] [gc][6] overhead, spent [302ms] collecting in the last [1.1s]
[2023-04-15T03:04:14,611][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-0] exception caught on transport layer [Netty4TcpChannel{localAddress=/10.233.71.139:9300, remoteAddress=/127.0.0.6:52455}], closing connection
java.lang.IllegalStateException: transport not ready yet to handle incoming requests
at org.elasticsearch.transport.TransportService.onRequestReceived(TransportService.java:943) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:136) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) [transport-netty4-client-7.9.3.jar:7.9.3]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) [netty-handler-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-04-15T03:04:15,610][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-0] exception caught on transport layer [Netty4TcpChannel{localAddress=/10.233.71.139:9300, remoteAddress=/127.0.0.6:35523}], closing connection
java.lang.IllegalStateException: transport not ready yet to handle incoming requests
at org.elasticsearch.transport.TransportService.onRequestReceived(TransportService.java:943) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:136) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) [transport-netty4-client-7.9.3.jar:7.9.3]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) [netty-handler-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-04-15T03:04:15,912][INFO ][o.e.b.BootstrapChecks ] [onap-sdnrdb-master-0] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2023-04-15T03:04:26,122][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-0] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}]; discovery will continue using [10.233.68.8:9300, 10.233.69.73:9300, 10.233.68.93:9300] from hosts providers and [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2023-04-15T03:04:36,129][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-0] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}]; discovery will continue using [10.233.68.8:9300, 10.233.69.73:9300, 10.233.68.93:9300] from hosts providers and [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2023-04-15T03:04:46,136][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-0] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}]; discovery will continue using [10.233.68.8:9300, 10.233.69.73:9300, 10.233.68.93:9300] from hosts providers and [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2023-04-15T03:04:54,001][INFO ][o.e.c.c.Coordinator ] [onap-sdnrdb-master-0] setting initial configuration to VotingConfiguration{F6fQxZJCQGu52Rg-kw5Agg,{bootstrap-placeholder}-onap-sdnrdb-master-2,nVCBw_YVQBeIjfTVMsyTdQ}
[2023-04-15T03:04:55,720][INFO ][o.e.c.c.JoinHelper ] [onap-sdnrdb-master-0] failed to join {onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} with JoinRequest{sourceNode={onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}, minimumTerm=0, optionalJoin=Optional[Join{term=1, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}, targetNode={onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}]}
org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-1][10.233.69.73:9300][internal:cluster/coordination/join]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: incoming term 1 does not match current term 2
at org.elasticsearch.cluster.coordination.CoordinationState.handleJoin(CoordinationState.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.handleJoin(Coordinator.java:1013) ~[elasticsearch-7.9.3.jar:7.9.3]
at java.util.Optional.ifPresent(Optional.java:183) ~[?:?]
at org.elasticsearch.cluster.coordination.Coordinator.processJoinRequest(Coordinator.java:532) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.lambda$handleJoinRequest$7(Coordinator.java:496) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.ClusterConnectionManager.connectToNode(ClusterConnectionManager.java:120) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:378) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:362) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:483) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:136) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:737) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-04-15T03:04:56,117][INFO ][o.e.c.c.JoinHelper ] [onap-sdnrdb-master-0] failed to join {onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr} with JoinRequest{sourceNode={onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}, minimumTerm=1, optionalJoin=Optional[Join{term=2, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}, targetNode={onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}}]}
org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.71.139:9300][internal:cluster/coordination/join]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: received a newer join from {onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}
at org.elasticsearch.cluster.coordination.JoinHelper$CandidateJoinAccumulator.handleJoinRequest(JoinHelper.java:459) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.processJoinRequest(Coordinator.java:533) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.lambda$handleJoinRequest$7(Coordinator.java:496) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:375) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:362) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:483) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:136) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TransportService$8.doRun(TransportService.java:800) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:737) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.9.3.jar:7.9.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-04-15T03:04:56,209][INFO ][o.e.c.c.JoinHelper ] [onap-sdnrdb-master-0] last failed join attempt was 483ms ago, failed to join {onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} with JoinRequest{sourceNode={onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}, minimumTerm=0, optionalJoin=Optional[Join{term=1, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}, targetNode={onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}]}
org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-1][10.233.69.73:9300][internal:cluster/coordination/join]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: incoming term 1 does not match current term 2
at org.elasticsearch.cluster.coordination.CoordinationState.handleJoin(CoordinationState.java:225) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.handleJoin(Coordinator.java:1013) ~[elasticsearch-7.9.3.jar:7.9.3]
at java.util.Optional.ifPresent(Optional.java:183) ~[?:?]
at org.elasticsearch.cluster.coordination.Coordinator.processJoinRequest(Coordinator.java:532) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.lambda$handleJoinRequest$7(Coordinator.java:496) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.ClusterConnectionManager.connectToNode(ClusterConnectionManager.java:120) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:378) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:362) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:483) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:136) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:737) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) [elasticsearch-7.9.3.jar:7.9.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-04-15T03:04:56,411][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-0] master not discovered or elected yet, an election requires 2 nodes with ids [F6fQxZJCQGu52Rg-kw5Agg, nVCBw_YVQBeIjfTVMsyTdQ], have discovered [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}] which is not a quorum; discovery will continue using [10.233.68.8:9300, 10.233.69.73:9300, 10.233.68.93:9300] from hosts providers and [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}] from last-known cluster state; node term 3, last-accepted version 0 in term 0
[2023-04-15T03:04:56,908][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] elected-as-master ([2] nodes joined)[{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr} elect leader, {onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 3, version: 1, delta: master node changed {previous [], current [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}]}, added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T03:04:58,197][INFO ][o.e.c.c.CoordinationState] [onap-sdnrdb-master-0] cluster UUID set to [7zM4O6sXTR-KxVNJTyVbSQ]
[2023-04-15T03:04:59,021][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] master node changed {previous [], current [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}]}, added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 1, reason: Publication{term=3, version=1}
[2023-04-15T03:04:59,609][INFO ][o.e.h.AbstractHttpServerTransport] [onap-sdnrdb-master-0] publish_address {10.233.71.139:9200}, bound_addresses {0.0.0.0:9200}
[2023-04-15T03:04:59,610][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader, {onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 3, version: 2, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T03:04:59,611][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] started
[2023-04-15T03:05:00,796][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 3, version: 2, reason: Publication{term=3, version=2}
[2023-04-15T03:05:01,105][INFO ][o.e.g.GatewayService ] [onap-sdnrdb-master-0] recovered [0] indices into cluster_state
[2023-04-15T03:05:08,109][INFO ][o.e.c.s.ClusterSettings ] [onap-sdnrdb-master-0] updating [action.auto_create_index] from [true] to [false]
[2023-04-15T03:05:11,614][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [mediator-server-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:05:12,213][INFO ][o.e.m.j.JvmGcMonitorService] [onap-sdnrdb-master-0] [gc][64] overhead, spent [296ms] collecting in the last [1s]
[2023-04-15T03:05:28,512][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [eventlog-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:05:32,723][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 3, version: 12, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T03:05:35,061][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 12, reason: Publication{term=3, version=12}
[2023-04-15T03:05:43,913][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [historicalperformance24h-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:05:59,112][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [userdata-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:06:08,508][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [faultcurrent-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:06:21,010][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [guicutthrough-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:06:27,415][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [faultlog-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:06:37,011][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [inventoryequipment-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:06:42,517][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [connectionlog-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:06:49,711][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [historicalperformance15min-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:06:56,014][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [cmlog-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:07:03,911][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [networkelement-connection-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:07:11,214][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [maintenancemode-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-04-15T03:07:21,397][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][4]]]).
[2023-04-15T04:04:54,220][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 3, version: 95, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T04:04:58,865][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 95, reason: Publication{term=3, version=95}
[2023-04-15T04:04:59,515][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [faultcurrent-v7][4] primary-replica resync completed with 0 operations
[2023-04-15T04:04:59,709][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [guicutthrough-v7][4] primary-replica resync completed with 0 operations
[2023-04-15T04:04:59,916][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [cmlog-v7][2] primary-replica resync completed with 0 operations
[2023-04-15T04:05:00,222][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [userdata-v7][4] primary-replica resync completed with 0 operations
[2023-04-15T04:05:00,710][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [53.1s] (43 delayed shards)
[2023-04-15T04:05:00,811][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [eventlog-v7][4] primary-replica resync completed with 0 operations
[2023-04-15T04:05:01,011][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [mediator-server-v7][1] primary-replica resync completed with 0 operations
[2023-04-15T04:05:01,310][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 3, version: 96, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T04:05:01,318][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [connectionlog-v7][2] primary-replica resync completed with 0 operations
[2023-04-15T04:05:01,909][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 3, version: 96, reason: Publication{term=3, version=96}
[2023-04-15T04:05:01,914][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 3, version: 97, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T04:05:02,224][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 97, reason: Publication{term=3, version=97}
[2023-04-15T04:05:02,508][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 3, version: 98, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T04:05:02,857][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 98, reason: Publication{term=3, version=98}
[2023-04-15T04:05:03,419][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 3, version: 99, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T04:05:05,216][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 99, reason: Publication{term=3, version=99}
[2023-04-15T04:05:05,221][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 3, version: 100, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T04:05:05,755][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 3, version: 100, reason: Publication{term=3, version=100}
[2023-04-15T04:06:04,484][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][1]]]).
[2023-04-15T04:07:26,809][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 3, version: 166, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T04:07:31,111][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 166, reason: Publication{term=3, version=166}
[2023-04-15T04:07:31,416][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [faultcurrent-v7][0] primary-replica resync completed with 0 operations
[2023-04-15T04:07:31,509][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [cmlog-v7][4] primary-replica resync completed with 0 operations
[2023-04-15T04:07:31,709][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [historicalperformance24h-v7][1] primary-replica resync completed with 0 operations
[2023-04-15T04:07:31,909][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [historicalperformance15min-v7][2] primary-replica resync completed with 0 operations
[2023-04-15T04:07:31,911][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [historicalperformance24h-v7][2] primary-replica resync completed with 0 operations
[2023-04-15T04:07:32,018][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [inventoryequipment-v7][2] primary-replica resync completed with 0 operations
[2023-04-15T04:07:32,220][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [userdata-v7][0] primary-replica resync completed with 0 operations
[2023-04-15T04:07:32,315][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [guicutthrough-v7][3] primary-replica resync completed with 0 operations
[2023-04-15T04:07:32,527][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [guicutthrough-v7][0] primary-replica resync completed with 0 operations
[2023-04-15T04:07:32,633][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [networkelement-connection-v7][3] primary-replica resync completed with 0 operations
[2023-04-15T04:07:32,736][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [networkelement-connection-v7][0] primary-replica resync completed with 0 operations
[2023-04-15T04:07:32,813][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [faultlog-v7][3] primary-replica resync completed with 0 operations
[2023-04-15T04:07:32,845][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [53.9s] (44 delayed shards)
[2023-04-15T04:07:32,911][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [faultlog-v7][0] primary-replica resync completed with 0 operations
[2023-04-15T04:07:32,912][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 3, version: 167, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T04:07:33,027][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [maintenancemode-v7][2] primary-replica resync completed with 0 operations
[2023-04-15T04:07:33,140][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [connectionlog-v7][4] primary-replica resync completed with 0 operations
[2023-04-15T04:07:33,269][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 167, reason: Publication{term=3, version=167}
[2023-04-15T04:07:33,408][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 3, version: 168, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T04:07:33,808][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 168, reason: Publication{term=3, version=168}
[2023-04-15T04:07:34,155][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 3, version: 169, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T04:07:37,759][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 169, reason: Publication{term=3, version=169}
[2023-04-15T04:08:38,161][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][4]]]).
[2023-04-15T05:05:03,311][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 3, version: 240, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T05:05:07,951][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 240, reason: Publication{term=3, version=240}
[2023-04-15T05:05:07,958][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [55.3s] (43 delayed shards)
[2023-04-15T05:05:08,009][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 3, version: 241, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T05:05:08,266][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 3, version: 241, reason: Publication{term=3, version=241}
[2023-04-15T05:05:08,271][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 3, version: 242, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T05:05:08,479][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 242, reason: Publication{term=3, version=242}
[2023-04-15T05:05:08,610][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 3, version: 243, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T05:05:08,936][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 243, reason: Publication{term=3, version=243}
[2023-04-15T05:05:09,210][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 3, version: 244, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T05:05:10,963][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 244, reason: Publication{term=3, version=244}
[2023-04-15T05:05:10,967][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 3, version: 245, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T05:05:11,161][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 3, version: 245, reason: Publication{term=3, version=245}
[2023-04-15T05:06:02,740][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][1]]]).
[2023-04-15T05:07:34,067][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 3, version: 314, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T05:07:37,127][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 314, reason: Publication{term=3, version=314}
[2023-04-15T05:07:37,133][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [56.9s] (44 delayed shards)
[2023-04-15T05:07:37,138][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 3, version: 315, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T05:07:37,631][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 315, reason: Publication{term=3, version=315}
[2023-04-15T05:07:37,715][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 3, version: 316, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T05:07:38,225][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 316, reason: Publication{term=3, version=316}
[2023-04-15T05:07:38,599][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 3, version: 317, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T05:07:40,641][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 317, reason: Publication{term=3, version=317}
[2023-04-15T05:08:26,621][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][4]]]).
[2023-04-15T06:04:51,155][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-0] invalid internal transport message format, got (4a,44,57,50), [Netty4TcpChannel{localAddress=/127.0.0.1:9300, remoteAddress=/127.0.0.1:50584}], closing connection
[2023-04-15T06:05:09,041][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 3, version: 386, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T06:05:12,658][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 386, reason: Publication{term=3, version=386}
[2023-04-15T06:05:12,665][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [56.3s] (43 delayed shards)
[2023-04-15T06:05:12,710][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 3, version: 387, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T06:05:13,047][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 3, version: 387, reason: Publication{term=3, version=387}
[2023-04-15T06:05:13,051][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 3, version: 388, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T06:05:13,547][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 388, reason: Publication{term=3, version=388}
[2023-04-15T06:05:13,616][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 3, version: 389, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T06:05:13,862][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 389, reason: Publication{term=3, version=389}
[2023-04-15T06:05:14,513][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 3, version: 390, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T06:05:16,351][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 390, reason: Publication{term=3, version=390}
[2023-04-15T06:05:16,356][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 3, version: 391, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T06:05:16,649][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 3, version: 391, reason: Publication{term=3, version=391}
[2023-04-15T06:06:01,468][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][0]]]).
[2023-04-15T06:07:38,578][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 3, version: 459, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T06:07:41,565][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 459, reason: Publication{term=3, version=459}
[2023-04-15T06:07:41,569][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57s] (44 delayed shards)
[2023-04-15T06:07:41,571][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 3, version: 460, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T06:07:41,876][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 460, reason: Publication{term=3, version=460}
[2023-04-15T06:07:42,014][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 3, version: 461, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T06:07:42,423][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 461, reason: Publication{term=3, version=461}
[2023-04-15T06:07:42,861][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 3, version: 462, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T06:07:44,757][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 462, reason: Publication{term=3, version=462}
[2023-04-15T06:08:26,316][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][4]]]).
[2023-04-15T07:05:14,424][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 3, version: 532, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T07:05:17,574][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 532, reason: Publication{term=3, version=532}
[2023-04-15T07:05:17,579][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [56.8s] (43 delayed shards)
[2023-04-15T07:05:17,582][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 3, version: 533, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T07:05:17,917][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 3, version: 533, reason: Publication{term=3, version=533}
[2023-04-15T07:05:17,923][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 3, version: 534, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T07:05:18,377][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 534, reason: Publication{term=3, version=534}
[2023-04-15T07:05:18,517][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 3, version: 535, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T07:05:18,819][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 535, reason: Publication{term=3, version=535}
[2023-04-15T07:05:19,509][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 3, version: 536, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T07:05:21,079][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 536, reason: Publication{term=3, version=536}
[2023-04-15T07:05:21,083][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 3, version: 537, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T07:05:21,213][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 3, version: 537, reason: Publication{term=3, version=537}
[2023-04-15T07:05:59,409][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][1]]]).
[2023-04-15T07:07:42,850][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 3, version: 604, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T07:07:46,369][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 604, reason: Publication{term=3, version=604}
[2023-04-15T07:07:46,373][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [56.4s] (44 delayed shards)
[2023-04-15T07:07:46,375][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 3, version: 605, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T07:07:46,780][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 605, reason: Publication{term=3, version=605}
[2023-04-15T07:07:46,833][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 3, version: 606, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T07:07:47,125][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 606, reason: Publication{term=3, version=606}
[2023-04-15T07:07:47,610][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 3, version: 607, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T07:07:49,192][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 607, reason: Publication{term=3, version=607}
[2023-04-15T07:08:36,340][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).
[2023-04-15T07:15:33,801][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-0] invalid internal transport message format, got (4a,44,57,50), [Netty4TcpChannel{localAddress=/127.0.0.1:9300, remoteAddress=/127.0.0.1:44944}], closing connection
[2023-04-15T08:05:19,356][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 3, version: 676, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T08:05:23,480][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 676, reason: Publication{term=3, version=676}
[2023-04-15T08:05:23,486][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [55.8s] (43 delayed shards)
[2023-04-15T08:05:23,490][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 3, version: 677, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T08:05:23,602][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 3, version: 677, reason: Publication{term=3, version=677}
[2023-04-15T08:05:23,605][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 3, version: 678, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T08:05:23,841][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 678, reason: Publication{term=3, version=678}
[2023-04-15T08:05:23,924][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 3, version: 679, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T08:05:24,075][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 679, reason: Publication{term=3, version=679}
[2023-04-15T08:05:24,326][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 3, version: 680, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T08:05:25,951][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 680, reason: Publication{term=3, version=680}
[2023-04-15T08:05:25,957][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader, {onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 3, version: 681, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T08:05:26,145][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 3, version: 681, reason: Publication{term=3, version=681}
[2023-04-15T08:06:08,086][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).
[2023-04-15T08:07:47,555][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 3, version: 747, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T08:07:50,986][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 747, reason: Publication{term=3, version=747}
[2023-04-15T08:07:50,995][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [56.5s] (44 delayed shards)
[2023-04-15T08:07:50,997][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 3, version: 748, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T08:07:51,247][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 748, reason: Publication{term=3, version=748}
[2023-04-15T08:07:51,312][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 3, version: 749, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T08:07:51,461][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 749, reason: Publication{term=3, version=749}
[2023-04-15T08:07:51,925][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 3, version: 750, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T08:07:53,776][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 3, version: 750, reason: Publication{term=3, version=750}
[2023-04-15T08:08:33,528][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][4]]]).
[2023-04-15T08:15:59,146][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-0] invalid internal transport message format, got (4a,44,57,50), [Netty4TcpChannel{localAddress=/127.0.0.1:9300, remoteAddress=/127.0.0.1:41938}], closing connection
[2023-04-15T09:05:24,209][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 3, version: 820, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T09:05:26,706][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 3, version: 820, reason: Publication{term=3, version=820}
[2023-04-15T09:05:26,717][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.4s] (43 delayed shards)
[2023-04-15T09:05:26,723][WARN ][o.e.c.c.C.CoordinatorPublication] [onap-sdnrdb-master-0] after [2.4s] publication of cluster state version [820] is still waiting for {onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} [SENT_APPLY_COMMIT]
[2023-04-15T09:05:26,723][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] master node changed {previous [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}], current []}, term: 3, version: 820, reason: becoming candidate: joinLeaderInTerm
[2023-04-15T09:05:27,091][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] elected-as-master ([2] nodes joined)[{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr} elect leader, {onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 5, version: 821, delta: master node changed {previous [], current [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}]}, added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T09:05:28,739][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] master node changed {previous [], current [{onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}]}, added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 821, reason: Publication{term=5, version=821}
[2023-04-15T09:05:29,242][INFO ][o.e.c.c.JoinHelper ] [onap-sdnrdb-master-0] failed to join {onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} with JoinRequest{sourceNode={onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}, minimumTerm=3, optionalJoin=Optional[Join{term=4, lastAcceptedTerm=3, lastAcceptedVersion=820, sourceNode={onap-sdnrdb-master-0}{F6fQxZJCQGu52Rg-kw5Agg}{t5FOe4GTRs6E3gZutuyV7w}{10.233.71.139}{10.233.71.139:9300}{dmr}, targetNode={onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}]}
org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-2][10.233.68.8:9300][internal:cluster/coordination/join]
Caused by: org.elasticsearch.cluster.coordination.FailedToCommitClusterStateException: node is no longer master for term 5 while handling publication
at org.elasticsearch.cluster.coordination.Coordinator.publish(Coordinator.java:1083) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.publish(MasterService.java:268) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:250) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:678) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) ~[elasticsearch-7.9.3.jar:7.9.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-04-15T09:06:02,029][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][0]]]).
[2023-04-15T09:07:51,870][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 888, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T09:07:54,903][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 888, reason: Publication{term=5, version=888}
[2023-04-15T09:07:54,905][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [56.9s] (44 delayed shards)
[2023-04-15T09:07:54,907][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 889, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T09:07:55,096][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 889, reason: Publication{term=5, version=889}
[2023-04-15T09:07:55,150][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 890, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T09:07:55,309][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 890, reason: Publication{term=5, version=890}
[2023-04-15T09:07:56,089][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 891, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T09:07:57,699][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 891, reason: Publication{term=5, version=891}
[2023-04-15T09:08:34,415][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).
[2023-04-15T10:05:26,746][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 5, version: 961, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T10:05:27,020][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 961, reason: Publication{term=5, version=961}
[2023-04-15T10:05:27,114][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 962, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T10:05:29,985][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 962, reason: Publication{term=5, version=962}
[2023-04-15T10:05:29,987][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.1s] (43 delayed shards)
[2023-04-15T10:05:29,989][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader, {onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 963, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r},{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T10:05:30,308][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r},{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 963, reason: Publication{term=5, version=963}
[2023-04-15T10:05:30,510][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 964, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T10:05:30,814][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 964, reason: Publication{term=5, version=964}
[2023-04-15T10:05:31,426][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 965, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T10:05:33,140][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 965, reason: Publication{term=5, version=965}
[2023-04-15T10:06:15,189][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][1]]]).
[2023-04-15T10:07:56,077][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 1031, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T10:07:58,257][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1031, reason: Publication{term=5, version=1031}
[2023-04-15T10:07:58,261][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.8s] (44 delayed shards)
[2023-04-15T10:07:58,649][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 1032, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T10:08:00,761][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1032, reason: Publication{term=5, version=1032}
[2023-04-15T10:08:47,205][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][2]]]).
[2023-04-15T11:05:29,201][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 5, version: 1104, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T11:05:29,352][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1104, reason: Publication{term=5, version=1104}
[2023-04-15T11:05:31,311][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 1105, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T11:05:33,641][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1105, reason: Publication{term=5, version=1105}
[2023-04-15T11:05:33,645][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.6s] (43 delayed shards)
[2023-04-15T11:05:33,647][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 5, version: 1106, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T11:05:33,908][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1106, reason: Publication{term=5, version=1106}
[2023-04-15T11:05:34,288][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 1107, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T11:05:36,353][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1107, reason: Publication{term=5, version=1107}
[2023-04-15T11:06:12,465][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).
[2023-04-15T11:07:58,630][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 1173, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T11:08:01,272][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1173, reason: Publication{term=5, version=1173}
[2023-04-15T11:08:01,275][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.3s] (44 delayed shards)
[2023-04-15T11:08:01,412][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 1174, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T11:08:03,236][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1174, reason: Publication{term=5, version=1174}
[2023-04-15T11:08:41,499][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).
[2023-04-15T12:05:31,299][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 5, version: 1246, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T12:05:31,413][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1246, reason: Publication{term=5, version=1246}
[2023-04-15T12:05:33,465][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 5, version: 1247, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T12:05:33,661][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1247, reason: Publication{term=5, version=1247}
[2023-04-15T12:05:34,205][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 1248, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T12:05:36,999][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1248, reason: Publication{term=5, version=1248}
[2023-04-15T12:05:37,002][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.1s] (43 delayed shards)
[2023-04-15T12:05:37,004][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 1249, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T12:05:37,187][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1249, reason: Publication{term=5, version=1249}
[2023-04-15T12:05:37,227][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 1250, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T12:05:37,342][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1250, reason: Publication{term=5, version=1250}
[2023-04-15T12:05:37,440][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 1251, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T12:05:38,711][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1251, reason: Publication{term=5, version=1251}
[2023-04-15T12:06:10,808][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][1]]]).
[2023-04-15T12:08:01,365][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 1318, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T12:08:03,657][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1318, reason: Publication{term=5, version=1318}
[2023-04-15T12:08:03,661][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.7s] (44 delayed shards)
[2023-04-15T12:08:04,279][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 1319, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T12:08:05,904][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1319, reason: Publication{term=5, version=1319}
[2023-04-15T12:08:45,883][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][4]]]).
[2023-04-15T13:05:33,424][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 5, version: 1390, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T13:05:33,551][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1390, reason: Publication{term=5, version=1390}
[2023-04-15T13:05:36,426][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 5, version: 1391, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T13:05:36,622][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1391, reason: Publication{term=5, version=1391}
[2023-04-15T13:05:37,349][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 1392, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T13:05:39,629][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1392, reason: Publication{term=5, version=1392}
[2023-04-15T13:05:39,633][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.7s] (43 delayed shards)
[2023-04-15T13:05:40,119][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 1393, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T13:05:41,317][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1393, reason: Publication{term=5, version=1393}
[2023-04-15T13:06:17,837][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][0]]]).
[2023-04-15T13:08:04,264][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 1460, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T13:08:06,495][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1460, reason: Publication{term=5, version=1460}
[2023-04-15T13:08:06,498][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.7s] (44 delayed shards)
[2023-04-15T13:08:06,702][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 1461, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T13:08:08,192][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1461, reason: Publication{term=5, version=1461}
[2023-04-15T13:08:45,109][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).
[2023-04-15T14:05:36,328][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 5, version: 1531, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T14:05:36,441][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1531, reason: Publication{term=5, version=1531}
[2023-04-15T14:05:38,544][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 5, version: 1532, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T14:05:38,719][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1532, reason: Publication{term=5, version=1532}
[2023-04-15T14:05:40,032][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 1533, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T14:05:42,618][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1533, reason: Publication{term=5, version=1533}
[2023-04-15T14:05:42,622][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.4s] (43 delayed shards)
[2023-04-15T14:05:43,198][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 1534, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T14:05:44,467][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1534, reason: Publication{term=5, version=1534}
[2023-04-15T14:06:18,991][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).
[2023-04-15T14:08:06,675][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 1601, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T14:08:10,504][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1601, reason: Publication{term=5, version=1601}
[2023-04-15T14:08:10,508][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [56.1s] (44 delayed shards)
[2023-04-15T14:08:10,509][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 1602, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T14:08:10,808][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1602, reason: Publication{term=5, version=1602}
[2023-04-15T14:08:10,853][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 1603, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T14:08:10,997][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1603, reason: Publication{term=5, version=1603}
[2023-04-15T14:08:11,387][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 1604, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T14:08:12,943][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1604, reason: Publication{term=5, version=1604}
[2023-04-15T14:08:50,683][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][4]]]).
[2023-04-15T14:29:38,612][INFO ][o.e.c.r.a.DiskThresholdMonitor] [onap-sdnrdb-master-0] skipping monitor as a check is already in progress
[2023-04-15T15:05:38,523][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 5, version: 1674, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T15:05:38,649][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1674, reason: Publication{term=5, version=1674}
[2023-04-15T15:05:41,624][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 5, version: 1675, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T15:05:41,783][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1675, reason: Publication{term=5, version=1675}
[2023-04-15T15:05:43,096][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 1676, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T15:05:45,621][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1676, reason: Publication{term=5, version=1676}
[2023-04-15T15:05:45,626][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.4s] (43 delayed shards)
[2023-04-15T15:05:46,216][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 1677, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T15:05:47,763][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1677, reason: Publication{term=5, version=1677}
[2023-04-15T15:06:21,013][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][0]]]).
[2023-04-15T15:08:11,354][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 1744, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T15:08:15,141][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1744, reason: Publication{term=5, version=1744}
[2023-04-15T15:08:15,145][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [56.2s] (44 delayed shards)
[2023-04-15T15:08:15,146][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 1745, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T15:08:15,431][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1745, reason: Publication{term=5, version=1745}
[2023-04-15T15:08:15,483][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 1746, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T15:08:15,573][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1746, reason: Publication{term=5, version=1746}
[2023-04-15T15:08:16,515][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 1747, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T15:08:18,034][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1747, reason: Publication{term=5, version=1747}
[2023-04-15T15:08:51,502][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).
[2023-04-15T15:36:11,305][INFO ][o.e.c.r.a.DiskThresholdMonitor] [onap-sdnrdb-master-0] skipping monitor as a check is already in progress
[2023-04-15T16:05:41,610][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 5, version: 1817, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T16:05:41,738][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1817, reason: Publication{term=5, version=1817}
[2023-04-15T16:05:44,510][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 5, version: 1818, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T16:05:44,679][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1818, reason: Publication{term=5, version=1818}
[2023-04-15T16:05:46,093][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 1819, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T16:05:48,350][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1819, reason: Publication{term=5, version=1819}
[2023-04-15T16:05:48,353][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.7s] (43 delayed shards)
[2023-04-15T16:05:48,493][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 1820, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T16:05:50,543][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1820, reason: Publication{term=5, version=1820}
[2023-04-15T16:06:23,855][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][0]]]).
[2023-04-15T16:08:16,477][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 1887, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T16:08:19,567][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1887, reason: Publication{term=5, version=1887}
[2023-04-15T16:08:19,571][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [56.9s] (44 delayed shards)
[2023-04-15T16:08:19,573][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 1888, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T16:08:19,737][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1888, reason: Publication{term=5, version=1888}
[2023-04-15T16:08:19,771][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 1889, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T16:08:19,872][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1889, reason: Publication{term=5, version=1889}
[2023-04-15T16:08:20,736][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 1890, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T16:08:22,124][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 1890, reason: Publication{term=5, version=1890}
[2023-04-15T16:09:04,711][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).
[2023-04-15T16:50:13,840][INFO ][o.e.c.r.a.DiskThresholdMonitor] [onap-sdnrdb-master-0] skipping monitor as a check is already in progress
[2023-04-15T17:05:44,453][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 5, version: 1961, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T17:05:44,570][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1961, reason: Publication{term=5, version=1961}
[2023-04-15T17:05:46,753][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 5, version: 1962, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T17:05:46,928][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 1962, reason: Publication{term=5, version=1962}
[2023-04-15T17:05:48,378][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 1963, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T17:05:50,691][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1963, reason: Publication{term=5, version=1963}
[2023-04-15T17:05:50,695][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.6s] (43 delayed shards)
[2023-04-15T17:05:51,355][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 1964, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T17:05:52,651][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 1964, reason: Publication{term=5, version=1964}
[2023-04-15T17:06:31,647][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][0]]]).
[2023-04-15T17:08:20,714][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 2030, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T17:08:24,292][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 2030, reason: Publication{term=5, version=2030}
[2023-04-15T17:08:24,295][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [56.4s] (44 delayed shards)
[2023-04-15T17:08:24,297][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 2031, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T17:08:24,495][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 2031, reason: Publication{term=5, version=2031}
[2023-04-15T17:08:24,531][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 2032, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T17:08:24,638][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 2032, reason: Publication{term=5, version=2032}
[2023-04-15T17:08:25,578][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 2033, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T17:08:26,923][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 2033, reason: Publication{term=5, version=2033}
[2023-04-15T17:09:12,504][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).
[2023-04-15T17:11:14,776][INFO ][o.e.c.r.a.DiskThresholdMonitor] [onap-sdnrdb-master-0] skipping monitor as a check is already in progress
[2023-04-15T18:05:46,735][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 5, version: 2104, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T18:05:46,874][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 2104, reason: Publication{term=5, version=2104}
[2023-04-15T18:05:49,669][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 5, version: 2105, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T18:05:49,902][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 2105, reason: Publication{term=5, version=2105}
[2023-04-15T18:05:51,181][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 2106, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T18:05:53,344][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 2106, reason: Publication{term=5, version=2106}
[2023-04-15T18:05:53,347][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.8s] (43 delayed shards)
[2023-04-15T18:05:53,436][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 2107, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T18:05:54,877][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 2107, reason: Publication{term=5, version=2107}
[2023-04-15T18:06:44,397][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][0]]]).
[2023-04-15T18:08:25,557][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 2174, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T18:08:27,895][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 2174, reason: Publication{term=5, version=2174}
[2023-04-15T18:08:27,898][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.6s] (44 delayed shards)
[2023-04-15T18:08:28,003][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 2175, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T18:08:29,544][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 2175, reason: Publication{term=5, version=2175}
[2023-04-15T18:09:17,270][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][4]]]).
[2023-04-15T18:41:48,146][INFO ][o.e.c.r.a.DiskThresholdMonitor] [onap-sdnrdb-master-0] skipping monitor as a check is already in progress
[2023-04-15T18:43:48,207][INFO ][o.e.c.r.a.DiskThresholdMonitor] [onap-sdnrdb-master-0] skipping monitor as a check is already in progress
[2023-04-15T19:05:49,641][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} reason: disconnected], term: 5, version: 2246, delta: removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T19:05:49,740][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 2246, reason: Publication{term=5, version=2246}
[2023-04-15T19:05:52,696][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r} join existing leader], term: 5, version: 2247, delta: added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}
[2023-04-15T19:05:52,897][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-5cd567c68c-rbr2k}{LI1S4AqBRAiMdVQyACfyuA}{3lBeHgx1Sy2pzPyswbik4A}{10.233.68.93}{10.233.68.93:9300}{r}}, term: 5, version: 2247, reason: Publication{term=5, version=2247}
[2023-04-15T19:05:53,340][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 2248, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T19:05:56,296][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 2248, reason: Publication{term=5, version=2248}
[2023-04-15T19:05:56,300][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57s] (43 delayed shards)
[2023-04-15T19:05:56,301][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 2249, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T19:05:56,500][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 2249, reason: Publication{term=5, version=2249}
[2023-04-15T19:05:56,548][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} reason: disconnected], term: 5, version: 2250, delta: removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T19:05:56,660][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 2250, reason: Publication{term=5, version=2250}
[2023-04-15T19:05:57,586][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr} join existing leader], term: 5, version: 2251, delta: added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}
[2023-04-15T19:05:58,652][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{nVCBw_YVQBeIjfTVMsyTdQ}{ij-QqOSyST6gPU3k0b_UnQ}{10.233.69.73}{10.233.69.73:9300}{dmr}}, term: 5, version: 2251, reason: Publication{term=5, version=2251}
[2023-04-15T19:06:30,702][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).
[2023-04-15T19:08:27,909][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} reason: disconnected], term: 5, version: 2318, delta: removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T19:08:30,118][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 2318, reason: Publication{term=5, version=2318}
[2023-04-15T19:08:30,122][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.7s] (44 delayed shards)
[2023-04-15T19:08:30,911][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr} join existing leader], term: 5, version: 2319, delta: added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}
[2023-04-15T19:08:33,827][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{PzmCln25SJGz3Nuwg6Oc5g}{_sZegl0HQtOktZWEel18iw}{10.233.68.8}{10.233.68.8:9300}{dmr}}, term: 5, version: 2319, reason: Publication{term=5, version=2319}
[2023-04-15T19:09:12,103][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][4]]]).
[2023-04-15T19:41:50,381][INFO ][o.e.c.r.a.DiskThresholdMonitor] [onap-sdnrdb-master-0] skipping monitor as a check is already in progress