23:24:15.15   23:24:15.16 Welcome to the Bitnami elasticsearch container  23:24:15.24 Subscribe to project updates by watching https://github.com/bitnami/bitnami-docker-elasticsearch  23:24:15.25 Submit issues and feature requests at https://github.com/bitnami/bitnami-docker-elasticsearch/issues  23:24:15.25   23:24:15.34 INFO  ==> ** Starting Elasticsearch setup **  23:24:15.64 INFO  ==> Configuring/Initializing Elasticsearch...  23:24:15.95 INFO  ==> Setting default configuration  23:24:16.14 INFO  ==> Configuring Elasticsearch cluster settings... OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.  23:24:35.04 INFO  ==> ** Elasticsearch setup finished! **  23:24:35.24 INFO  ==> ** Starting Elasticsearch ** OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. [2022-09-06T23:25:15,048][INFO ][o.e.n.Node ] [onap-sdnrdb-master-1] version[7.9.3], pid[1], build[oss/tar/c4138e51121ef06a6404866cddc601906fe5c868/2020-10-16T10:36:16.141335Z], OS[Linux/5.4.0-96-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/11.0.9/11.0.9+11-LTS] [2022-09-06T23:25:15,141][INFO ][o.e.n.Node ] [onap-sdnrdb-master-1] JVM home [/opt/bitnami/java] [2022-09-06T23:25:15,142][INFO ][o.e.n.Node ] [onap-sdnrdb-master-1] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms128m, -Xmx128m, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Djava.io.tmpdir=/tmp/elasticsearch-4392956434553854517, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=67108864, -Des.path.home=/opt/bitnami/elasticsearch, -Des.path.conf=/opt/bitnami/elasticsearch/config, -Des.distribution.flavor=oss, -Des.distribution.type=tar, -Des.bundled_jdk=true] [2022-09-06T23:25:33,054][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [aggs-matrix-stats] [2022-09-06T23:25:33,055][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [analysis-common] [2022-09-06T23:25:33,140][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [geo] [2022-09-06T23:25:33,140][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [ingest-common] [2022-09-06T23:25:33,141][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [ingest-geoip] [2022-09-06T23:25:33,141][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [ingest-user-agent] [2022-09-06T23:25:33,142][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [kibana] [2022-09-06T23:25:33,142][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [lang-expression] [2022-09-06T23:25:33,143][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [lang-mustache] [2022-09-06T23:25:33,144][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [lang-painless] [2022-09-06T23:25:33,144][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [mapper-extras] [2022-09-06T23:25:33,145][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [parent-join] [2022-09-06T23:25:33,145][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [percolator] [2022-09-06T23:25:33,146][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [rank-eval] [2022-09-06T23:25:33,147][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [reindex] [2022-09-06T23:25:33,147][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [repository-url] [2022-09-06T23:25:33,148][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [tasks] [2022-09-06T23:25:33,148][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded module [transport-netty4] [2022-09-06T23:25:33,240][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-1] loaded plugin [repository-s3] [2022-09-06T23:25:33,851][INFO ][o.e.e.NodeEnvironment ] [onap-sdnrdb-master-1] using [1] data paths, mounts [[/bitnami/elasticsearch/data (192.168.13.44:/dockerdata-nfs/onap/elastic-master-2)]], net usable_space [95.2gb], net total_space [99.9gb], types [nfs4] [2022-09-06T23:25:33,852][INFO ][o.e.e.NodeEnvironment ] [onap-sdnrdb-master-1] heap size [123.7mb], compressed ordinary object pointers [true] [2022-09-06T23:25:34,352][INFO ][o.e.n.Node ] [onap-sdnrdb-master-1] node name [onap-sdnrdb-master-1], node ID [S4Oa4QrmTfu1EY_BrD6s0Q], cluster name [sdnrdb-cluster] [2022-09-06T23:26:26,547][INFO ][o.e.t.NettyAllocator ] [onap-sdnrdb-master-1] creating NettyAllocator with the following configs: [name=unpooled, factors={es.unsafe.use_unpooled_allocator=false, g1gc_enabled=false, g1gc_region_size=0b, heap_size=123.7mb}] [2022-09-06T23:26:27,650][INFO ][o.e.d.DiscoveryModule ] [onap-sdnrdb-master-1] using discovery type [zen] and seed hosts providers [settings] [2022-09-06T23:26:31,653][WARN ][o.e.g.DanglingIndicesState] [onap-sdnrdb-master-1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually [2022-09-06T23:26:33,946][INFO ][o.e.n.Node ] [onap-sdnrdb-master-1] initialized [2022-09-06T23:26:33,947][INFO ][o.e.n.Node ] [onap-sdnrdb-master-1] starting ... [2022-09-06T23:26:35,561][INFO ][o.e.t.TransportService ] [onap-sdnrdb-master-1] publish_address {10.233.72.86:9300}, bound_addresses {0.0.0.0:9300} [2022-09-06T23:26:37,543][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-1] exception caught on transport layer [Netty4TcpChannel{localAddress=/10.233.72.86:9300, remoteAddress=/127.0.0.6:40871}], closing connection java.lang.IllegalStateException: transport not ready yet to handle incoming requests at org.elasticsearch.transport.TransportService.onRequestReceived(TransportService.java:943) ~[elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:136) ~[elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) [elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) [elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) [elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) [elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) [transport-netty4-client-7.9.3.jar:7.9.3] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) [netty-handler-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final] at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final] at java.lang.Thread.run(Thread.java:834) [?:?] [2022-09-06T23:26:37,840][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-1] exception caught on transport layer [Netty4TcpChannel{localAddress=/10.233.72.86:9300, remoteAddress=/127.0.0.6:51517}], closing connection java.lang.IllegalStateException: transport not ready yet to handle incoming requests at org.elasticsearch.transport.TransportService.onRequestReceived(TransportService.java:943) ~[elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundHandler.handleRequest(InboundHandler.java:136) ~[elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundHandler.messageReceived(InboundHandler.java:93) ~[elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundHandler.inboundMessage(InboundHandler.java:78) ~[elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.TcpTransport.inboundMessage(TcpTransport.java:692) [elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundPipeline.forwardFragments(InboundPipeline.java:142) [elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:117) [elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:82) [elasticsearch-7.9.3.jar:7.9.3] at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:76) [transport-netty4-client-7.9.3.jar:7.9.3] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:271) [netty-handler-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) [netty-codec-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:163) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:714) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:615) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:578) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:493) [netty-transport-4.1.49.Final.jar:4.1.49.Final] at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) [netty-common-4.1.49.Final.jar:4.1.49.Final] at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.49.Final.jar:4.1.49.Final] at java.lang.Thread.run(Thread.java:834) [?:?] [2022-09-06T23:26:38,552][INFO ][o.e.b.BootstrapChecks ] [onap-sdnrdb-master-1] bound or publishing to a non-loopback address, enforcing bootstrap checks [2022-09-06T23:26:46,153][INFO ][o.e.m.j.JvmGcMonitorService] [onap-sdnrdb-master-1] [gc][12] overhead, spent [284ms] collecting in the last [1s] [2022-09-06T23:26:48,659][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-1] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-1}{S4Oa4QrmTfu1EY_BrD6s0Q}{1_O-gBHHRAiSZZEjnrycyw}{10.233.72.86}{10.233.72.86:9300}{dmr}]; discovery will continue using [10.233.70.147:9300, 10.233.71.243:9300, 10.233.68.187:9300] from hosts providers and [{onap-sdnrdb-master-1}{S4Oa4QrmTfu1EY_BrD6s0Q}{1_O-gBHHRAiSZZEjnrycyw}{10.233.72.86}{10.233.72.86:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 [2022-09-06T23:26:58,662][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-1] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-1}{S4Oa4QrmTfu1EY_BrD6s0Q}{1_O-gBHHRAiSZZEjnrycyw}{10.233.72.86}{10.233.72.86:9300}{dmr}]; discovery will continue using [10.233.70.147:9300, 10.233.71.243:9300, 10.233.68.187:9300] from hosts providers and [{onap-sdnrdb-master-1}{S4Oa4QrmTfu1EY_BrD6s0Q}{1_O-gBHHRAiSZZEjnrycyw}{10.233.72.86}{10.233.72.86:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 [2022-09-06T23:27:08,666][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-1] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-1}{S4Oa4QrmTfu1EY_BrD6s0Q}{1_O-gBHHRAiSZZEjnrycyw}{10.233.72.86}{10.233.72.86:9300}{dmr}]; discovery will continue using [10.233.70.147:9300, 10.233.71.243:9300, 10.233.68.187:9300] from hosts providers and [{onap-sdnrdb-master-1}{S4Oa4QrmTfu1EY_BrD6s0Q}{1_O-gBHHRAiSZZEjnrycyw}{10.233.72.86}{10.233.72.86:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 [2022-09-06T23:27:10,174][INFO ][o.e.c.c.Coordinator ] [onap-sdnrdb-master-1] setting initial configuration to VotingConfiguration{S4Oa4QrmTfu1EY_BrD6s0Q,{bootstrap-placeholder}-onap-sdnrdb-master-0,WL8P5_SUQyWrAiOlD7UTHA} [2022-09-06T23:27:11,841][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] elected-as-master ([2] nodes joined)[{onap-sdnrdb-master-1}{S4Oa4QrmTfu1EY_BrD6s0Q}{1_O-gBHHRAiSZZEjnrycyw}{10.233.72.86}{10.233.72.86:9300}{dmr} elect leader, {onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: master node changed {previous [], current [{onap-sdnrdb-master-1}{S4Oa4QrmTfu1EY_BrD6s0Q}{1_O-gBHHRAiSZZEjnrycyw}{10.233.72.86}{10.233.72.86:9300}{dmr}]}, added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-06T23:27:12,940][INFO ][o.e.c.c.CoordinationState] [onap-sdnrdb-master-1] cluster UUID set to [-2GjppgeTrmNsdDlmbzgzg] [2022-09-06T23:27:13,644][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] master node changed {previous [], current [{onap-sdnrdb-master-1}{S4Oa4QrmTfu1EY_BrD6s0Q}{1_O-gBHHRAiSZZEjnrycyw}{10.233.72.86}{10.233.72.86:9300}{dmr}]}, added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 1, reason: Publication{term=1, version=1} [2022-09-06T23:27:13,942][INFO ][o.e.h.AbstractHttpServerTransport] [onap-sdnrdb-master-1] publish_address {10.233.72.86:9200}, bound_addresses {0.0.0.0:9200} [2022-09-06T23:27:13,945][INFO ][o.e.n.Node ] [onap-sdnrdb-master-1] started [2022-09-06T23:27:14,341][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r} join existing leader], term: 1, version: 2, delta: added {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}} [2022-09-06T23:27:14,678][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}}, term: 1, version: 2, reason: Publication{term=1, version=2} [2022-09-06T23:27:14,941][INFO ][o.e.g.GatewayService ] [onap-sdnrdb-master-1] recovered [0] indices into cluster_state [2022-09-06T23:27:42,387][INFO ][o.e.c.s.ClusterSettings ] [onap-sdnrdb-master-1] updating [action.auto_create_index] from [true] to [false] [2022-09-06T23:27:45,441][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [mediator-server-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:27:59,148][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [faultcurrent-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:28:04,946][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [maintenancemode-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:28:09,844][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [guicutthrough-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:28:15,944][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [eventlog-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:28:24,149][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [userdata-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:28:27,740][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [cmlog-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:28:32,348][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [faultlog-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:28:36,751][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [networkelement-connection-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:28:42,146][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [historicalperformance24h-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:28:47,352][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [inventoryequipment-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:28:52,140][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [historicalperformance15min-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:28:56,442][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-1] [connectionlog-v7] creating index, cause [api], templates [], shards [5]/[1] [2022-09-06T23:29:09,734][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][4]]]). [2022-09-06T23:30:21,256][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr} join existing leader], term: 1, version: 93, delta: added {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}} [2022-09-06T23:30:28,458][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}}, term: 1, version: 93, reason: Publication{term=1, version=93} [2022-09-07T00:27:09,446][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} reason: disconnected], term: 1, version: 161, delta: removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T00:27:17,716][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 161, reason: Publication{term=1, version=161} [2022-09-07T00:27:17,948][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [guicutthrough-v7][0] primary-replica resync completed with 0 operations [2022-09-07T00:27:18,041][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [userdata-v7][0] primary-replica resync completed with 0 operations [2022-09-07T00:27:18,140][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [networkelement-connection-v7][1] primary-replica resync completed with 0 operations [2022-09-07T00:27:18,240][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [faultlog-v7][0] primary-replica resync completed with 0 operations [2022-09-07T00:27:18,340][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [connectionlog-v7][1] primary-replica resync completed with 0 operations [2022-09-07T00:27:18,448][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [faultcurrent-v7][0] primary-replica resync completed with 0 operations [2022-09-07T00:27:18,553][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [inventoryequipment-v7][1] primary-replica resync completed with 0 operations [2022-09-07T00:27:18,643][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [historicalperformance24h-v7][2] primary-replica resync completed with 0 operations [2022-09-07T00:27:18,744][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-1] scheduling reroute for delayed shards in [50.3s] (43 delayed shards) [2022-09-07T00:27:18,840][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [historicalperformance24h-v7][0] primary-replica resync completed with 0 operations [2022-09-07T00:27:19,039][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [historicalperformance15min-v7][0] primary-replica resync completed with 0 operations [2022-09-07T00:27:19,143][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r} reason: disconnected], term: 1, version: 162, delta: removed {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}} [2022-09-07T00:27:19,411][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}}, term: 1, version: 162, reason: Publication{term=1, version=162} [2022-09-07T00:27:19,416][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} join existing leader], term: 1, version: 163, delta: added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T00:27:20,924][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 163, reason: Publication{term=1, version=163} [2022-09-07T00:27:21,140][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} reason: disconnected], term: 1, version: 164, delta: removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T00:27:21,327][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 164, reason: Publication{term=1, version=164} [2022-09-07T00:27:21,331][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} join existing leader], term: 1, version: 165, delta: added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T00:27:21,909][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 165, reason: Publication{term=1, version=165} [2022-09-07T00:27:21,959][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} reason: disconnected], term: 1, version: 166, delta: removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T00:27:22,510][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 166, reason: Publication{term=1, version=166} [2022-09-07T00:27:22,514][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r} join existing leader, {onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} join existing leader], term: 1, version: 167, delta: added {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r},{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T00:27:23,819][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r},{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 167, reason: Publication{term=1, version=167} [2022-09-07T00:27:23,853][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} reason: disconnected], term: 1, version: 168, delta: removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T00:27:24,139][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 168, reason: Publication{term=1, version=168} [2022-09-07T00:27:24,145][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} join existing leader], term: 1, version: 169, delta: added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T00:27:24,723][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 169, reason: Publication{term=1, version=169} [2022-09-07T00:27:24,761][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} reason: disconnected], term: 1, version: 170, delta: removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T00:27:25,039][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 170, reason: Publication{term=1, version=170} [2022-09-07T00:27:25,339][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} join existing leader], term: 1, version: 171, delta: added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T00:27:27,384][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 171, reason: Publication{term=1, version=171} [2022-09-07T00:28:34,887][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][1]]]). [2022-09-07T00:30:20,344][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr} reason: disconnected], term: 1, version: 238, delta: removed {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}} [2022-09-07T00:30:22,901][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}}, term: 1, version: 238, reason: Publication{term=1, version=238} [2022-09-07T00:30:22,946][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [guicutthrough-v7][2] primary-replica resync completed with 0 operations [2022-09-07T00:30:23,039][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [guicutthrough-v7][4] primary-replica resync completed with 0 operations [2022-09-07T00:30:23,052][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [historicalperformance24h-v7][4] primary-replica resync completed with 0 operations [2022-09-07T00:30:23,140][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [faultcurrent-v7][2] primary-replica resync completed with 0 operations [2022-09-07T00:30:23,341][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [faultcurrent-v7][4] primary-replica resync completed with 0 operations [2022-09-07T00:30:23,440][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [userdata-v7][4] primary-replica resync completed with 0 operations [2022-09-07T00:30:23,443][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [userdata-v7][2] primary-replica resync completed with 0 operations [2022-09-07T00:30:23,448][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [historicalperformance15min-v7][4] primary-replica resync completed with 0 operations [2022-09-07T00:30:23,544][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-1] scheduling reroute for delayed shards in [56.7s] (44 delayed shards) [2022-09-07T00:30:23,639][WARN ][o.e.c.c.Coordinator ] [onap-sdnrdb-master-1] failed to validate incoming join request from node [{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}] org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-0][10.233.68.187:9300][internal:cluster/coordination/join/validate] disconnected [2022-09-07T00:30:23,741][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [faultlog-v7][2] primary-replica resync completed with 0 operations [2022-09-07T00:30:23,843][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-1] [faultlog-v7][4] primary-replica resync completed with 0 operations [2022-09-07T00:30:24,301][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr} join existing leader], term: 1, version: 239, delta: added {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}} [2022-09-07T00:30:29,639][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}}, term: 1, version: 239, reason: Publication{term=1, version=239} [2022-09-07T00:31:59,910][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][1]]]). [2022-09-07T01:27:21,485][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r} reason: disconnected], term: 1, version: 309, delta: removed {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}} [2022-09-07T01:27:21,719][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}}, term: 1, version: 309, reason: Publication{term=1, version=309} [2022-09-07T01:27:24,291][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r} join existing leader], term: 1, version: 310, delta: added {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}} [2022-09-07T01:27:24,598][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}}, term: 1, version: 310, reason: Publication{term=1, version=310} [2022-09-07T01:27:25,144][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} reason: disconnected], term: 1, version: 311, delta: removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T01:27:30,645][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 311, reason: Publication{term=1, version=311} [2022-09-07T01:27:30,651][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-1] scheduling reroute for delayed shards in [54.4s] (43 delayed shards) [2022-09-07T01:27:30,742][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} join existing leader], term: 1, version: 312, delta: added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T01:27:30,987][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 312, reason: Publication{term=1, version=312} [2022-09-07T01:27:31,147][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} reason: disconnected], term: 1, version: 313, delta: removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T01:27:31,376][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 313, reason: Publication{term=1, version=313} [2022-09-07T01:27:31,848][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} join existing leader], term: 1, version: 314, delta: added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T01:27:32,905][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 314, reason: Publication{term=1, version=314} [2022-09-07T01:28:25,264][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][0]]]). [2022-09-07T01:30:03,643][INFO ][o.e.m.j.JvmGcMonitorService] [onap-sdnrdb-master-1] [gc][7404] overhead, spent [524ms] collecting in the last [1.4s] [2022-09-07T01:30:24,039][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr} reason: disconnected], term: 1, version: 380, delta: removed {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}} [2022-09-07T01:30:25,799][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}}, term: 1, version: 380, reason: Publication{term=1, version=380} [2022-09-07T01:30:25,802][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-1] scheduling reroute for delayed shards in [58.1s] (44 delayed shards) [2022-09-07T01:30:27,156][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr} join existing leader], term: 1, version: 381, delta: added {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}} [2022-09-07T01:30:30,376][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}}, term: 1, version: 381, reason: Publication{term=1, version=381} [2022-09-07T01:31:39,427][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][4]]]). [2022-09-07T02:27:24,268][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r} reason: disconnected], term: 1, version: 452, delta: removed {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}} [2022-09-07T02:27:24,555][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}}, term: 1, version: 452, reason: Publication{term=1, version=452} [2022-09-07T02:27:26,778][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r} join existing leader], term: 1, version: 453, delta: added {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}} [2022-09-07T02:27:26,994][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}}, term: 1, version: 453, reason: Publication{term=1, version=453} [2022-09-07T02:27:31,842][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} reason: disconnected], term: 1, version: 454, delta: removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T02:27:37,597][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 454, reason: Publication{term=1, version=454} [2022-09-07T02:27:37,603][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-1] scheduling reroute for delayed shards in [54.2s] (43 delayed shards) [2022-09-07T02:27:37,605][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} join existing leader], term: 1, version: 455, delta: added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T02:27:38,097][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 455, reason: Publication{term=1, version=455} [2022-09-07T02:27:38,148][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} reason: disconnected], term: 1, version: 456, delta: removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T02:27:38,375][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 456, reason: Publication{term=1, version=456} [2022-09-07T02:27:39,014][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} join existing leader], term: 1, version: 457, delta: added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T02:27:40,242][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 457, reason: Publication{term=1, version=457} [2022-09-07T02:28:40,755][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][1]]]). [2022-09-07T02:30:26,904][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr} reason: disconnected], term: 1, version: 524, delta: removed {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}} [2022-09-07T02:30:28,734][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}}, term: 1, version: 524, reason: Publication{term=1, version=524} [2022-09-07T02:30:28,737][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-1] scheduling reroute for delayed shards in [58.1s] (44 delayed shards) [2022-09-07T02:30:29,586][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr} join existing leader], term: 1, version: 525, delta: added {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}} [2022-09-07T02:30:33,970][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}}, term: 1, version: 525, reason: Publication{term=1, version=525} [2022-09-07T02:31:55,696][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][2]]]). [2022-09-07T03:27:26,763][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r} reason: disconnected], term: 1, version: 596, delta: removed {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}} [2022-09-07T03:27:27,090][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}}, term: 1, version: 596, reason: Publication{term=1, version=596} [2022-09-07T03:27:29,466][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r} join existing leader], term: 1, version: 597, delta: added {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}} [2022-09-07T03:27:29,660][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-coordinating-only-7c4fc6d7fd-sn5jg}{WfLGo3A_QxKK96JpHM4tUA}{KNbvU1DYSEeFMLr6npttHw}{10.233.70.147}{10.233.70.147:9300}{r}}, term: 1, version: 597, reason: Publication{term=1, version=597} [2022-09-07T03:27:39,045][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} reason: disconnected], term: 1, version: 598, delta: removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T03:27:44,876][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 598, reason: Publication{term=1, version=598} [2022-09-07T03:27:44,881][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-1] scheduling reroute for delayed shards in [54s] (43 delayed shards) [2022-09-07T03:27:44,883][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} join existing leader], term: 1, version: 599, delta: added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T03:27:45,554][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 599, reason: Publication{term=1, version=599} [2022-09-07T03:27:45,635][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} reason: disconnected], term: 1, version: 600, delta: removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T03:27:45,802][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 600, reason: Publication{term=1, version=600} [2022-09-07T03:27:46,476][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr} join existing leader], term: 1, version: 601, delta: added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}} [2022-09-07T03:27:47,767][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-2}{WL8P5_SUQyWrAiOlD7UTHA}{cE-UmzvfTnSAoG1yU7LnuQ}{10.233.71.243}{10.233.71.243:9300}{dmr}}, term: 1, version: 601, reason: Publication{term=1, version=601} [2022-09-07T03:28:25,992][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][1]]]). [2022-09-07T03:30:29,249][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-left[{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr} reason: disconnected], term: 1, version: 669, delta: removed {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}} [2022-09-07T03:30:31,650][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] removed {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}}, term: 1, version: 669, reason: Publication{term=1, version=669} [2022-09-07T03:30:31,654][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-1] scheduling reroute for delayed shards in [57.5s] (44 delayed shards) [2022-09-07T03:30:31,971][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-1] node-join[{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr} join existing leader], term: 1, version: 670, delta: added {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}} [2022-09-07T03:30:36,472][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-1] added {{onap-sdnrdb-master-0}{gFHhvXY8Qpi0lPkJHlKVqg}{1gI-7dH4Qd-_eBwB8pc7tQ}{10.233.68.187}{10.233.68.187:9300}{dmr}}, term: 1, version: 670, reason: Publication{term=1, version=670} [2022-09-07T03:31:27,006][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[mediator-server-v7][3]]]).