By type
[38;5;6m [38;5;5m00:25:41.34 [0m
[38;5;6m [38;5;5m00:25:41.34 [0m[1mWelcome to the Bitnami elasticsearch container[0m
[38;5;6m [38;5;5m00:25:41.42 [0mSubscribe to project updates by watching [1mhttps://github.com/bitnami/bitnami-docker-elasticsearch[0m
[38;5;6m [38;5;5m00:25:41.42 [0mSubmit issues and feature requests at [1mhttps://github.com/bitnami/bitnami-docker-elasticsearch/issues[0m
[38;5;6m [38;5;5m00:25:41.43 [0m
[38;5;6m [38;5;5m00:25:41.44 [0m[38;5;2mINFO [0m ==> ** Starting Elasticsearch setup **
[38;5;6m [38;5;5m00:25:41.86 [0m[38;5;2mINFO [0m ==> Configuring/Initializing Elasticsearch...
[38;5;6m [38;5;5m00:25:42.14 [0m[38;5;2mINFO [0m ==> Setting default configuration
[38;5;6m [38;5;5m00:25:42.32 [0m[38;5;2mINFO [0m ==> Configuring Elasticsearch cluster settings...
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[38;5;6m [38;5;5m00:26:01.52 [0m[38;5;2mINFO [0m ==> ** Elasticsearch setup finished! **
[38;5;6m [38;5;5m00:26:01.63 [0m[38;5;2mINFO [0m ==> ** Starting Elasticsearch **
OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
[2023-02-15T00:26:42,032][INFO ][o.e.n.Node ] [onap-sdnrdb-master-2] version[7.9.3], pid[1], build[oss/tar/c4138e51121ef06a6404866cddc601906fe5c868/2020-10-16T10:36:16.141335Z], OS[Linux/5.4.0-96-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/11.0.9/11.0.9+11-LTS]
[2023-02-15T00:26:42,125][INFO ][o.e.n.Node ] [onap-sdnrdb-master-2] JVM home [/opt/bitnami/java]
[2023-02-15T00:26:42,222][INFO ][o.e.n.Node ] [onap-sdnrdb-master-2] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms128m, -Xmx128m, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Djava.io.tmpdir=/tmp/elasticsearch-13200269526636993765, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=67108864, -Des.path.home=/opt/bitnami/elasticsearch, -Des.path.conf=/opt/bitnami/elasticsearch/config, -Des.distribution.flavor=oss, -Des.distribution.type=tar, -Des.bundled_jdk=true]
[2023-02-15T00:27:01,927][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [aggs-matrix-stats]
[2023-02-15T00:27:01,929][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [analysis-common]
[2023-02-15T00:27:01,929][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [geo]
[2023-02-15T00:27:02,022][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [ingest-common]
[2023-02-15T00:27:02,023][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [ingest-geoip]
[2023-02-15T00:27:02,023][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [ingest-user-agent]
[2023-02-15T00:27:02,024][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [kibana]
[2023-02-15T00:27:02,024][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [lang-expression]
[2023-02-15T00:27:02,025][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [lang-mustache]
[2023-02-15T00:27:02,025][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [lang-painless]
[2023-02-15T00:27:02,026][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [mapper-extras]
[2023-02-15T00:27:02,026][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [parent-join]
[2023-02-15T00:27:02,027][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [percolator]
[2023-02-15T00:27:02,027][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [rank-eval]
[2023-02-15T00:27:02,027][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [reindex]
[2023-02-15T00:27:02,028][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [repository-url]
[2023-02-15T00:27:02,028][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [tasks]
[2023-02-15T00:27:02,029][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded module [transport-netty4]
[2023-02-15T00:27:02,030][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-2] loaded plugin [repository-s3]
[2023-02-15T00:27:02,732][INFO ][o.e.e.NodeEnvironment ] [onap-sdnrdb-master-2] using [1] data paths, mounts [[/bitnami/elasticsearch/data (192.168.13.92:/dockerdata-nfs/onap/elastic-master-0)]], net usable_space [95.6gb], net total_space [99.9gb], types [nfs4]
[2023-02-15T00:27:02,733][INFO ][o.e.e.NodeEnvironment ] [onap-sdnrdb-master-2] heap size [123.7mb], compressed ordinary object pointers [true]
[2023-02-15T00:27:03,337][INFO ][o.e.n.Node ] [onap-sdnrdb-master-2] node name [onap-sdnrdb-master-2], node ID [V9qLgGsXT-KEzEKM0lyePg], cluster name [sdnrdb-cluster]
[2023-02-15T00:27:58,124][INFO ][o.e.t.NettyAllocator ] [onap-sdnrdb-master-2] creating NettyAllocator with the following configs: [name=unpooled, factors={es.unsafe.use_unpooled_allocator=false, g1gc_enabled=false, g1gc_region_size=0b, heap_size=123.7mb}]
[2023-02-15T00:27:59,126][INFO ][o.e.d.DiscoveryModule ] [onap-sdnrdb-master-2] using discovery type [zen] and seed hosts providers [settings]
[2023-02-15T00:28:02,539][WARN ][o.e.g.DanglingIndicesState] [onap-sdnrdb-master-2] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2023-02-15T00:28:05,028][INFO ][o.e.n.Node ] [onap-sdnrdb-master-2] initialized
[2023-02-15T00:28:05,029][INFO ][o.e.n.Node ] [onap-sdnrdb-master-2] starting ...
[2023-02-15T00:28:07,226][INFO ][o.e.t.TransportService ] [onap-sdnrdb-master-2] publish_address {10.233.67.21:9300}, bound_addresses {0.0.0.0:9300}
[2023-02-15T00:28:08,425][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-2] exception caught on transport layer [Netty4TcpChannel{localAddress=/10.233.67.21:9300, remoteAddress=/127.0.0.6:37033}], closing connection
java.lang.IllegalStateException: transport not ready yet to handle incoming requests
at org.elasticsearch.transport.TransportService.onRequestReceived(TransportService.java:943) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:136) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) [transport-netty4-client-7.9.3.jar:7.9.3]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) [netty-handler-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-02-15T00:28:09,623][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-2] exception caught on transport layer [Netty4TcpChannel{localAddress=/10.233.67.21:9300, remoteAddress=/127.0.0.6:47815}], closing connection
java.lang.IllegalStateException: transport not ready yet to handle incoming requests
at org.elasticsearch.transport.TransportService.onRequestReceived(TransportService.java:943) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:136) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) [transport-netty4-client-7.9.3.jar:7.9.3]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) [netty-handler-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-02-15T00:28:10,624][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-2] exception caught on transport layer [Netty4TcpChannel{localAddress=/10.233.67.21:9300, remoteAddress=/127.0.0.6:46111}], closing connection
java.lang.IllegalStateException: transport not ready yet to handle incoming requests
at org.elasticsearch.transport.TransportService.onRequestReceived(TransportService.java:943) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:136) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) [transport-netty4-client-7.9.3.jar:7.9.3]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) [netty-handler-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-02-15T00:28:10,732][INFO ][o.e.b.BootstrapChecks ] [onap-sdnrdb-master-2] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2023-02-15T00:28:21,129][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-2] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}]; discovery will continue using [10.233.70.39:9300, 10.233.67.95:9300, 10.233.71.167:9300] from hosts providers and [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2023-02-15T00:28:31,132][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-2] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}]; discovery will continue using [10.233.70.39:9300, 10.233.67.95:9300, 10.233.71.167:9300] from hosts providers and [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2023-02-15T00:28:41,137][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-2] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}]; discovery will continue using [10.233.70.39:9300, 10.233.67.95:9300, 10.233.71.167:9300] from hosts providers and [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2023-02-15T00:28:51,142][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-2] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}]; discovery will continue using [10.233.70.39:9300, 10.233.67.95:9300, 10.233.71.167:9300] from hosts providers and [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2023-02-15T00:29:01,146][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-2] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}]; discovery will continue using [10.233.70.39:9300, 10.233.67.95:9300, 10.233.71.167:9300] from hosts providers and [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2023-02-15T00:29:09,189][INFO ][o.e.c.c.Coordinator ] [onap-sdnrdb-master-2] setting initial configuration to VotingConfiguration{{bootstrap-placeholder}-onap-sdnrdb-master-1,cuWaMbNuQdWA3QsM8gkuyg,V9qLgGsXT-KEzEKM0lyePg}
[2023-02-15T00:29:11,223][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-2] master not discovered or elected yet, an election requires 2 nodes with ids [cuWaMbNuQdWA3QsM8gkuyg, V9qLgGsXT-KEzEKM0lyePg], have discovered [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}, {onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}] which is a quorum; discovery will continue using [10.233.70.39:9300, 10.233.67.95:9300, 10.233.71.167:9300] from hosts providers and [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
[2023-02-15T00:29:12,125][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] elected-as-master ([2] nodes joined)[{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr} elect leader, {onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: master node changed {previous [], current [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}]}, added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T00:29:12,244][WARN ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] failing [elected-as-master ([2] nodes joined)[{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr} elect leader, {onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_]]: failed to commit cluster state version [1]
org.elasticsearch.cluster.coordination.FailedToCommitClusterStateException: node is no longer master for term 1 while handling publication
at org.elasticsearch.cluster.coordination.Coordinator.publish(Coordinator.java:1083) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.publish(MasterService.java:268) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:250) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:678) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.9.3.jar:7.9.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-02-15T00:29:12,324][INFO ][o.e.c.c.JoinHelper ] [onap-sdnrdb-master-2] failed to join {onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr} with JoinRequest{sourceNode={onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}, minimumTerm=0, optionalJoin=Optional[Join{term=1, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}, targetNode={onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}}]}
org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-2][10.233.67.21:9300][internal:cluster/coordination/join]
Caused by: org.elasticsearch.cluster.coordination.FailedToCommitClusterStateException: node is no longer master for term 1 while handling publication
at org.elasticsearch.cluster.coordination.Coordinator.publish(Coordinator.java:1083) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.publish(MasterService.java:268) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:250) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:678) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) [elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) [elasticsearch-7.9.3.jar:7.9.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-02-15T00:29:12,990][INFO ][o.e.c.c.JoinHelper ] [onap-sdnrdb-master-2] failed to join {onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} with JoinRequest{sourceNode={onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}, minimumTerm=3, optionalJoin=Optional.empty}
org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.71.167:9300][internal:cluster/coordination/join]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: received a newer join from {onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}
at org.elasticsearch.cluster.coordination.JoinHelper$CandidateJoinAccumulator.handleJoinRequest(JoinHelper.java:459) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.processJoinRequest(Coordinator.java:533) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.lambda$handleJoinRequest$7(Coordinator.java:496) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.action.ActionListener$1.onResponse(ActionListener.java:63) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.ClusterConnectionManager.connectToNode(ClusterConnectionManager.java:120) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:378) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.TransportService.connectToNode(TransportService.java:362) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.handleJoinRequest(Coordinator.java:483) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.JoinHelper.lambda$new$0(JoinHelper.java:136) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:72) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.transport.InboundHandler$RequestHandler.doRun(InboundHandler.java:263) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:737) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-02-15T00:29:14,430][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] elected-as-master ([2] nodes joined)[{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr} elect leader, {onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 4, version: 1, delta: master node changed {previous [], current [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}]}, added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T00:29:14,587][INFO ][o.e.c.c.JoinHelper ] [onap-sdnrdb-master-2] failed to join {onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} with JoinRequest{sourceNode={onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}, minimumTerm=1, optionalJoin=Optional[Join{term=2, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}, targetNode={onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}]}
org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.71.167:9300][internal:cluster/coordination/join]
Caused by: org.elasticsearch.cluster.coordination.FailedToCommitClusterStateException: node is no longer master for term 3 while handling publication
at org.elasticsearch.cluster.coordination.Coordinator.publish(Coordinator.java:1083) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.publish(MasterService.java:268) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:250) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:678) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) ~[elasticsearch-7.9.3.jar:7.9.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-02-15T00:29:14,623][INFO ][o.e.c.c.JoinHelper ] [onap-sdnrdb-master-2] failed to join {onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} with JoinRequest{sourceNode={onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}, minimumTerm=2, optionalJoin=Optional[Join{term=3, lastAcceptedTerm=0, lastAcceptedVersion=0, sourceNode={onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}, targetNode={onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}]}
org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.71.167:9300][internal:cluster/coordination/join]
Caused by: org.elasticsearch.cluster.coordination.FailedToCommitClusterStateException: node is no longer master for term 4 while handling publication
at org.elasticsearch.cluster.coordination.Coordinator.publish(Coordinator.java:1083) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.publish(MasterService.java:268) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:250) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService.access$000(MasterService.java:73) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:151) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:678) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:252) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:215) ~[elasticsearch-7.9.3.jar:7.9.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-02-15T00:29:14,889][INFO ][o.e.c.c.JoinHelper ] [onap-sdnrdb-master-2] failed to join {onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} with JoinRequest{sourceNode={onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}, minimumTerm=4, optionalJoin=Optional.empty}
org.elasticsearch.transport.RemoteTransportException: [onap-sdnrdb-master-0][10.233.71.167:9300][internal:cluster/coordination/join]
Caused by: org.elasticsearch.cluster.coordination.CoordinationStateRejectedException: became follower
at org.elasticsearch.cluster.coordination.JoinHelper$CandidateJoinAccumulator.lambda$close$3(JoinHelper.java:484) ~[elasticsearch-7.9.3.jar:7.9.3]
at java.util.HashMap$Values.forEach(HashMap.java:976) ~[?:?]
at org.elasticsearch.cluster.coordination.JoinHelper$CandidateJoinAccumulator.close(JoinHelper.java:484) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.becomeFollower(Coordinator.java:621) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.Coordinator.onFollowerCheckRequest(Coordinator.java:257) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.cluster.coordination.FollowersChecker$2.doRun(FollowersChecker.java:198) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:737) ~[elasticsearch-7.9.3.jar:7.9.3]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-7.9.3.jar:7.9.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) ~[?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) ~[?:?]
at java.lang.Thread.run(Thread.java:834) [?:?]
[2023-02-15T00:29:16,203][INFO ][o.e.c.c.CoordinationState] [onap-sdnrdb-master-2] cluster UUID set to [L324NG6PQzGjzJ47CzBdIg]
[2023-02-15T00:29:16,793][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] master node changed {previous [], current [{onap-sdnrdb-master-2}{V9qLgGsXT-KEzEKM0lyePg}{qSaKw7qTQU6281rteQJLzA}{10.233.67.21}{10.233.67.21:9300}{dmr}]}, added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 1, reason: Publication{term=4, version=1}
[2023-02-15T00:29:16,924][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} join existing leader], term: 4, version: 2, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T00:29:17,130][INFO ][o.e.h.AbstractHttpServerTransport] [onap-sdnrdb-master-2] publish_address {10.233.67.21:9200}, bound_addresses {0.0.0.0:9200}
[2023-02-15T00:29:17,131][INFO ][o.e.n.Node ] [onap-sdnrdb-master-2] started
[2023-02-15T00:29:17,922][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 2, reason: Publication{term=4, version=2}
[2023-02-15T00:29:18,526][INFO ][o.e.g.GatewayService ] [onap-sdnrdb-master-2] recovered [0] indices into cluster_state
[2023-02-15T00:29:20,493][INFO ][o.e.c.s.ClusterSettings ] [onap-sdnrdb-master-2] updating [action.auto_create_index] from [true] to [false]
[2023-02-15T00:29:24,424][INFO ][o.e.m.j.JvmGcMonitorService] [onap-sdnrdb-master-2] [gc][79] overhead, spent [495ms] collecting in the last [1s]
[2023-02-15T00:29:24,729][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [userdata-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:29:47,745][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [faultlog-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:29:53,590][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 15, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T00:29:55,505][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 15, reason: Publication{term=4, version=15}
[2023-02-15T00:29:58,633][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [historicalperformance15min-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:30:22,222][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [networkelement-connection-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:30:34,528][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [cmlog-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:30:45,324][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [connectionlog-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:30:54,028][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [maintenancemode-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:31:03,226][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [mediator-server-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:31:09,733][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [eventlog-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:31:18,513][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [inventoryequipment-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:31:27,029][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [faultcurrent-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:31:36,978][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [guicutthrough-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:31:45,060][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-2] [historicalperformance24h-v7] creating index, cause [api], templates [], shards [5]/[1]
[2023-02-15T00:31:57,649][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][4]]]).
[2023-02-15T01:29:09,428][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 93, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T01:29:13,154][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 93, reason: Publication{term=4, version=93}
[2023-02-15T01:29:13,627][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [inventoryequipment-v7][2] primary-replica resync completed with 0 operations
[2023-02-15T01:29:13,722][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [faultlog-v7][3] primary-replica resync completed with 0 operations
[2023-02-15T01:29:13,727][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [networkelement-connection-v7][3] primary-replica resync completed with 0 operations
[2023-02-15T01:29:13,923][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [historicalperformance24h-v7][1] primary-replica resync completed with 0 operations
[2023-02-15T01:29:14,124][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [historicalperformance24h-v7][4] primary-replica resync completed with 0 operations
[2023-02-15T01:29:14,230][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [faultcurrent-v7][1] primary-replica resync completed with 0 operations
[2023-02-15T01:29:14,526][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [faultcurrent-v7][4] primary-replica resync completed with 0 operations
[2023-02-15T01:29:14,825][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [historicalperformance15min-v7][3] primary-replica resync completed with 0 operations
[2023-02-15T01:29:14,831][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [connectionlog-v7][3] primary-replica resync completed with 0 operations
[2023-02-15T01:29:14,931][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [eventlog-v7][0] primary-replica resync completed with 0 operations
[2023-02-15T01:29:15,030][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [connectionlog-v7][0] primary-replica resync completed with 0 operations
[2023-02-15T01:29:15,038][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [maintenancemode-v7][3] primary-replica resync completed with 0 operations
[2023-02-15T01:29:15,141][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [maintenancemode-v7][0] primary-replica resync completed with 0 operations
[2023-02-15T01:29:15,237][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [53.5s] (43 delayed shards)
[2023-02-15T01:29:15,324][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [userdata-v7][2] primary-replica resync completed with 0 operations
[2023-02-15T01:29:15,426][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [userdata-v7][0] primary-replica resync completed with 0 operations
[2023-02-15T01:29:15,631][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} reason: disconnected], term: 4, version: 94, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T01:29:15,822][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [guicutthrough-v7][2] primary-replica resync completed with 0 operations
[2023-02-15T01:29:15,974][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 94, reason: Publication{term=4, version=94}
[2023-02-15T01:29:16,028][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 95, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T01:29:16,559][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 95, reason: Publication{term=4, version=95}
[2023-02-15T01:29:16,733][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 96, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T01:29:17,023][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 96, reason: Publication{term=4, version=96}
[2023-02-15T01:29:17,030][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 97, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T01:29:17,473][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 97, reason: Publication{term=4, version=97}
[2023-02-15T01:29:17,628][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 98, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T01:29:17,962][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 98, reason: Publication{term=4, version=98}
[2023-02-15T01:29:17,970][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 99, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T01:29:18,457][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 99, reason: Publication{term=4, version=99}
[2023-02-15T01:29:18,626][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 100, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T01:29:18,760][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 100, reason: Publication{term=4, version=100}
[2023-02-15T01:29:18,764][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} join existing leader], term: 4, version: 101, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T01:29:19,161][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 101, reason: Publication{term=4, version=101}
[2023-02-15T01:29:19,165][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 102, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T01:29:21,705][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 102, reason: Publication{term=4, version=102}
[2023-02-15T01:29:53,329][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 148, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T01:29:59,959][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 148, reason: Publication{term=4, version=148}
[2023-02-15T01:30:00,326][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [eventlog-v7][1] primary-replica resync completed with 0 operations
[2023-02-15T01:30:00,427][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [networkelement-connection-v7][0] primary-replica resync completed with 0 operations
[2023-02-15T01:30:00,628][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [mediator-server-v7][3] primary-replica resync completed with 0 operations
[2023-02-15T01:30:00,832][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [mediator-server-v7][0] primary-replica resync completed with 0 operations
[2023-02-15T01:30:01,028][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [historicalperformance15min-v7][2] primary-replica resync completed with 0 operations
[2023-02-15T01:30:01,134][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [historicalperformance15min-v7][0] primary-replica resync completed with 0 operations
[2023-02-15T01:30:01,133][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 149, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T01:30:01,326][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [cmlog-v7][3] primary-replica resync completed with 0 operations
[2023-02-15T01:30:01,427][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-2] [cmlog-v7][0] primary-replica resync completed with 0 operations
[2023-02-15T01:30:01,563][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 149, reason: Publication{term=4, version=149}
[2023-02-15T01:30:01,724][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 150, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T01:30:03,122][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 150, reason: Publication{term=4, version=150}
[2023-02-15T01:30:04,330][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 152, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T01:30:04,775][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 152, reason: Publication{term=4, version=152}
[2023-02-15T01:30:04,922][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 153, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T01:30:05,122][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 153, reason: Publication{term=4, version=153}
[2023-02-15T01:30:06,124][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 155, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T01:30:09,575][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 155, reason: Publication{term=4, version=155}
[2023-02-15T01:30:14,126][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[userdata-v7][4], [cmlog-v7][4], [cmlog-v7][1], [faultlog-v7][1]]]).
[2023-02-15T01:30:15,973][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [37s] (34 delayed shards)
[2023-02-15T01:31:00,109][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][3]]]).
[2023-02-15T02:29:18,035][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} reason: disconnected], term: 4, version: 224, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T02:29:18,204][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 224, reason: Publication{term=4, version=224}
[2023-02-15T02:29:18,929][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 225, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T02:29:22,829][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 225, reason: Publication{term=4, version=225}
[2023-02-15T02:29:22,837][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [56s] (43 delayed shards)
[2023-02-15T02:29:22,839][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} join existing leader, {onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 226, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r},{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T02:29:23,813][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r},{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 226, reason: Publication{term=4, version=226}
[2023-02-15T02:29:23,853][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 227, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T02:29:24,065][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 227, reason: Publication{term=4, version=227}
[2023-02-15T02:29:24,540][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 228, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T02:29:27,167][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 228, reason: Publication{term=4, version=228}
[2023-02-15T02:30:05,826][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 272, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T02:30:10,948][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 272, reason: Publication{term=4, version=272}
[2023-02-15T02:30:11,732][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 274, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T02:30:11,960][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 274, reason: Publication{term=4, version=274}
[2023-02-15T02:30:12,032][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 275, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T02:30:13,228][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 275, reason: Publication{term=4, version=275}
[2023-02-15T02:30:14,095][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 277, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T02:30:14,336][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 277, reason: Publication{term=4, version=277}
[2023-02-15T02:30:14,435][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 278, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T02:30:14,727][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 278, reason: Publication{term=4, version=278}
[2023-02-15T02:30:16,261][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 281, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T02:30:18,218][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 281, reason: Publication{term=4, version=281}
[2023-02-15T02:30:22,188][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[guicutthrough-v7][0], [cmlog-v7][4]]]).
[2023-02-15T02:30:23,837][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [41.9s] (33 delayed shards)
[2023-02-15T02:31:20,705][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][3]]]).
[2023-02-15T03:29:20,832][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} reason: disconnected], term: 4, version: 355, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T03:29:20,902][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 355, reason: Publication{term=4, version=355}
[2023-02-15T03:29:23,923][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} join existing leader], term: 4, version: 356, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T03:29:24,131][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 356, reason: Publication{term=4, version=356}
[2023-02-15T03:29:24,428][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 357, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T03:29:27,472][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 357, reason: Publication{term=4, version=357}
[2023-02-15T03:29:27,477][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [56.8s] (43 delayed shards)
[2023-02-15T03:29:27,479][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 358, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T03:29:27,794][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 358, reason: Publication{term=4, version=358}
[2023-02-15T03:29:27,854][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 359, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T03:29:27,968][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 359, reason: Publication{term=4, version=359}
[2023-02-15T03:29:28,804][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 360, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T03:29:31,035][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 360, reason: Publication{term=4, version=360}
[2023-02-15T03:30:14,057][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][2]]]).
[2023-02-15T03:30:15,123][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 427, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T03:30:20,513][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 427, reason: Publication{term=4, version=427}
[2023-02-15T03:30:20,516][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [54.5s] (44 delayed shards)
[2023-02-15T03:30:20,518][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 428, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T03:30:20,704][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 428, reason: Publication{term=4, version=428}
[2023-02-15T03:30:20,769][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 429, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T03:30:20,923][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 429, reason: Publication{term=4, version=429}
[2023-02-15T03:30:20,927][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 430, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T03:30:21,058][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 430, reason: Publication{term=4, version=430}
[2023-02-15T03:30:21,129][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 431, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T03:30:21,345][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 431, reason: Publication{term=4, version=431}
[2023-02-15T03:30:21,937][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 432, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T03:30:23,767][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 432, reason: Publication{term=4, version=432}
[2023-02-15T03:31:01,570][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][3]]]).
[2023-02-15T04:29:23,817][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} reason: disconnected], term: 4, version: 505, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T04:29:23,978][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 505, reason: Publication{term=4, version=505}
[2023-02-15T04:29:26,851][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} join existing leader], term: 4, version: 506, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T04:29:27,103][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 506, reason: Publication{term=4, version=506}
[2023-02-15T04:29:28,592][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 507, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T04:29:31,422][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 507, reason: Publication{term=4, version=507}
[2023-02-15T04:29:31,426][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [57.1s] (43 delayed shards)
[2023-02-15T04:29:31,428][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 508, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T04:29:31,704][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 508, reason: Publication{term=4, version=508}
[2023-02-15T04:29:31,827][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 509, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T04:29:31,895][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 509, reason: Publication{term=4, version=509}
[2023-02-15T04:29:32,082][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 510, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T04:29:33,694][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 510, reason: Publication{term=4, version=510}
[2023-02-15T04:30:19,946][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][0]]]).
[2023-02-15T04:30:21,848][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 577, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T04:30:26,477][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 577, reason: Publication{term=4, version=577}
[2023-02-15T04:30:26,482][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [55.3s] (44 delayed shards)
[2023-02-15T04:30:26,483][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 578, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T04:30:27,080][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 578, reason: Publication{term=4, version=578}
[2023-02-15T04:30:27,130][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 579, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T04:30:27,420][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 579, reason: Publication{term=4, version=579}
[2023-02-15T04:30:28,005][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 580, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T04:30:29,551][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 580, reason: Publication{term=4, version=580}
[2023-02-15T04:30:58,629][INFO ][o.e.m.j.JvmGcMonitorService] [onap-sdnrdb-master-2] [gc][14563] overhead, spent [601ms] collecting in the last [1.3s]
[2023-02-15T04:31:03,749][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][4]]]).
[2023-02-15T05:29:26,833][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} reason: disconnected], term: 4, version: 653, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T05:29:27,054][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 653, reason: Publication{term=4, version=653}
[2023-02-15T05:29:28,989][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} join existing leader], term: 4, version: 654, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T05:29:29,153][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 654, reason: Publication{term=4, version=654}
[2023-02-15T05:29:31,923][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 655, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T05:29:36,056][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 655, reason: Publication{term=4, version=655}
[2023-02-15T05:29:36,059][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [55.8s] (43 delayed shards)
[2023-02-15T05:29:36,061][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 656, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T05:29:36,587][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 656, reason: Publication{term=4, version=656}
[2023-02-15T05:29:36,674][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 657, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T05:29:36,749][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 657, reason: Publication{term=4, version=657}
[2023-02-15T05:29:37,770][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 658, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T05:29:40,269][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 658, reason: Publication{term=4, version=658}
[2023-02-15T05:30:28,225][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 720, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T05:30:35,467][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 720, reason: Publication{term=4, version=720}
[2023-02-15T05:30:35,471][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 721, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T05:30:35,764][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 721, reason: Publication{term=4, version=721}
[2023-02-15T05:30:35,830][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 722, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T05:30:36,806][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 722, reason: Publication{term=4, version=722}
[2023-02-15T05:30:36,810][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 723, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T05:30:37,065][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 723, reason: Publication{term=4, version=723}
[2023-02-15T05:30:37,122][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 724, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T05:30:37,367][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 724, reason: Publication{term=4, version=724}
[2023-02-15T05:30:37,372][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[userdata-v7][2], [userdata-v7][0], [userdata-v7][4]]]).
[2023-02-15T05:30:37,990][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 727, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T05:30:40,291][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 727, reason: Publication{term=4, version=727}
[2023-02-15T05:30:40,861][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [47.2s] (43 delayed shards)
[2023-02-15T05:31:18,914][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][4]]]).
[2023-02-15T06:29:28,980][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} reason: disconnected], term: 4, version: 798, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T06:29:29,154][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 798, reason: Publication{term=4, version=798}
[2023-02-15T06:29:31,965][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} join existing leader], term: 4, version: 799, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T06:29:32,149][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 799, reason: Publication{term=4, version=799}
[2023-02-15T06:29:37,594][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 800, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T06:29:43,809][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 800, reason: Publication{term=4, version=800}
[2023-02-15T06:29:43,816][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [53.7s] (43 delayed shards)
[2023-02-15T06:29:43,817][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 801, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T06:29:44,925][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 801, reason: Publication{term=4, version=801}
[2023-02-15T06:29:45,028][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 802, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T06:29:45,794][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 802, reason: Publication{term=4, version=802}
[2023-02-15T06:29:45,797][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 803, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T06:29:46,703][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 803, reason: Publication{term=4, version=803}
[2023-02-15T06:29:46,932][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 804, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T06:29:47,220][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 804, reason: Publication{term=4, version=804}
[2023-02-15T06:29:47,225][WARN ][o.e.c.c.Coordinator ] [onap-sdnrdb-master-2] failed to validate incoming join request from node [{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}]
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.71.167:9300][internal:cluster/coordination/join/validate] disconnected
[2023-02-15T06:29:48,257][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 805, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T06:29:53,082][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 805, reason: Publication{term=4, version=805}
[2023-02-15T06:30:38,333][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 862, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T06:30:44,144][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 862, reason: Publication{term=4, version=862}
[2023-02-15T06:30:44,152][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 863, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T06:30:44,644][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 863, reason: Publication{term=4, version=863}
[2023-02-15T06:30:44,712][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 864, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T06:30:45,661][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 864, reason: Publication{term=4, version=864}
[2023-02-15T06:30:46,187][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 866, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T06:30:46,365][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 866, reason: Publication{term=4, version=866}
[2023-02-15T06:30:46,406][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 867, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T06:30:46,488][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 867, reason: Publication{term=4, version=867}
[2023-02-15T06:30:46,492][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[userdata-v7][4], [faultlog-v7][1]]]).
[2023-02-15T06:30:46,897][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 869, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T06:30:47,161][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 869, reason: Publication{term=4, version=869}
[2023-02-15T06:30:47,204][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 870, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T06:30:47,457][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 870, reason: Publication{term=4, version=870}
[2023-02-15T06:30:47,823][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 872, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T06:30:49,952][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 872, reason: Publication{term=4, version=872}
[2023-02-15T06:30:50,739][WARN ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] [userdata-v7][4] marking unavailable shards as stale: [UVzeHfSiTy6F0nYSEhEO4A]
[2023-02-15T06:30:50,740][WARN ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] [faultlog-v7][1] marking unavailable shards as stale: [7S2hiE2WQ7uBluywuKcGaQ]
[2023-02-15T06:30:53,624][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [44.6s] (39 delayed shards)
[2023-02-15T06:31:35,208][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[faultlog-v7][0]]]).
[2023-02-15T07:29:32,023][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} reason: disconnected], term: 4, version: 944, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T07:29:32,182][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 944, reason: Publication{term=4, version=944}
[2023-02-15T07:29:35,129][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} join existing leader], term: 4, version: 945, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T07:29:35,454][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 945, reason: Publication{term=4, version=945}
[2023-02-15T07:29:48,127][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 946, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T07:29:51,370][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 946, reason: Publication{term=4, version=946}
[2023-02-15T07:29:51,375][WARN ][o.e.c.c.Coordinator ] [onap-sdnrdb-master-2] failed to validate incoming join request from node [{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}]
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.71.167:9300][internal:cluster/coordination/join/validate] disconnected
[2023-02-15T07:29:51,378][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [56.7s] (43 delayed shards)
[2023-02-15T07:29:52,214][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 948, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T07:29:54,318][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 948, reason: Publication{term=4, version=948}
[2023-02-15T07:30:37,324][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][4]]]).
[2023-02-15T07:30:47,490][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 1014, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T07:30:51,239][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 1014, reason: Publication{term=4, version=1014}
[2023-02-15T07:30:51,243][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [56.2s] (44 delayed shards)
[2023-02-15T07:30:51,244][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 1015, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T07:30:51,610][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 1015, reason: Publication{term=4, version=1015}
[2023-02-15T07:30:51,657][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 1016, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T07:30:52,004][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 1016, reason: Publication{term=4, version=1016}
[2023-02-15T07:30:52,009][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 1017, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T07:30:52,261][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 1017, reason: Publication{term=4, version=1017}
[2023-02-15T07:30:52,364][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 1018, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T07:30:52,437][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 1018, reason: Publication{term=4, version=1018}
[2023-02-15T07:30:52,962][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 1019, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T07:30:55,153][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 1019, reason: Publication{term=4, version=1019}
[2023-02-15T07:31:34,697][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][3]]]).
[2023-02-15T08:29:35,112][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} reason: disconnected], term: 4, version: 1090, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T08:29:35,612][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 1090, reason: Publication{term=4, version=1090}
[2023-02-15T08:29:38,045][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r} join existing leader], term: 4, version: 1091, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}
[2023-02-15T08:29:38,410][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-coordinating-only-54c85fc557-sl525}{rW8A9Aq0Qdq2ek-fBYgAWg}{c2ju0B_PQUW0ZmmMcuLAXg}{10.233.67.95}{10.233.67.95:9300}{r}}, term: 4, version: 1091, reason: Publication{term=4, version=1091}
[2023-02-15T08:29:52,023][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 1093, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T08:29:57,548][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 1093, reason: Publication{term=4, version=1093}
[2023-02-15T08:29:57,553][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [54.4s] (43 delayed shards)
[2023-02-15T08:29:57,555][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 1094, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T08:29:57,904][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 1094, reason: Publication{term=4, version=1094}
[2023-02-15T08:29:58,024][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} reason: disconnected], term: 4, version: 1095, delta: removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T08:29:58,136][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 1095, reason: Publication{term=4, version=1095}
[2023-02-15T08:29:58,143][WARN ][o.e.c.c.Coordinator ] [onap-sdnrdb-master-2] failed to validate incoming join request from node [{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}]
org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.71.167:9300][internal:cluster/coordination/join/validate] disconnected
[2023-02-15T08:29:59,093][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr} join existing leader], term: 4, version: 1096, delta: added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}
[2023-02-15T08:30:01,916][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-0}{cuWaMbNuQdWA3QsM8gkuyg}{lLjiXTqGSWG118a4lGhPZw}{10.233.71.167}{10.233.71.167:9300}{dmr}}, term: 4, version: 1096, reason: Publication{term=4, version=1096}
[2023-02-15T08:30:53,110][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 1162, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T08:30:57,560][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 1162, reason: Publication{term=4, version=1162}
[2023-02-15T08:30:57,563][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-2] scheduling reroute for delayed shards in [55.5s] (44 delayed shards)
[2023-02-15T08:30:58,454][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 1164, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T08:30:58,676][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 1164, reason: Publication{term=4, version=1164}
[2023-02-15T08:30:58,735][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-left[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} reason: disconnected], term: 4, version: 1165, delta: removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T08:30:58,830][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] removed {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 1165, reason: Publication{term=4, version=1165}
[2023-02-15T08:30:58,959][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-2] node-join[{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr} join existing leader], term: 4, version: 1166, delta: added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}
[2023-02-15T08:31:02,308][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-2] added {{onap-sdnrdb-master-1}{cxWLeRfoQWyTcZDIBjDHhA}{2mGI-QPXSye9jc-i4-HoaA}{10.233.70.39}{10.233.70.39:9300}{dmr}}, term: 4, version: 1166, reason: Publication{term=4, version=1166}
[2023-02-15T08:32:17,861][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-2] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][3]]]).