By type
[38;5;6m [38;5;5m11:47:02.05 [0m [38;5;6m [38;5;5m11:47:02.05 [0m[1mWelcome to the Bitnami elasticsearch container[0m [38;5;6m [38;5;5m11:47:02.06 [0mSubscribe to project updates by watching [1mhttps://github.com/bitnami/bitnami-docker-elasticsearch[0m [38;5;6m [38;5;5m11:47:02.06 [0mSubmit issues and feature requests at [1mhttps://github.com/bitnami/bitnami-docker-elasticsearch/issues[0m [38;5;6m [38;5;5m11:47:02.14 [0m [38;5;6m [38;5;5m11:47:02.15 [0m[38;5;2mINFO [0m ==> ** Starting Elasticsearch setup ** [38;5;6m [38;5;5m11:47:02.44 [0m[38;5;2mINFO [0m ==> Configuring/Initializing Elasticsearch... [38;5;6m [38;5;5m11:47:02.65 [0m[38;5;2mINFO [0m ==> Setting default configuration [38;5;6m [38;5;5m11:47:02.74 [0m[38;5;2mINFO [0m ==> Configuring Elasticsearch cluster settings... OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. [38;5;6m [38;5;5m11:47:21.35 [0m[38;5;2mINFO [0m ==> ** Elasticsearch setup finished! ** [38;5;6m [38;5;5m11:47:21.45 [0m[38;5;2mINFO [0m ==> ** Starting Elasticsearch ** OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. [2023-03-21T11:48:05,141][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] version[7.9.3], pid[1], build[oss/tar/c4138e51121ef06a6404866cddc601906fe5c868/2020-10-16T10:36:16.141335Z], OS[Linux/5.4.0-96-generic/amd64], JVM[BellSoft/OpenJDK 64-Bit Server VM/11.0.9/11.0.9+11-LTS] [2023-03-21T11:48:05,240][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] JVM home [/opt/bitnami/java] [2023-03-21T11:48:05,241][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms128m, -Xmx128m, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Djava.io.tmpdir=/tmp/elasticsearch-15285150293734236397, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -XX:MaxDirectMemorySize=67108864, -Des.path.home=/opt/bitnami/elasticsearch, -Des.path.conf=/opt/bitnami/elasticsearch/config, -Des.distribution.flavor=oss, -Des.distribution.type=tar, -Des.bundled_jdk=true] [2023-03-21T11:48:28,942][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [aggs-matrix-stats] [2023-03-21T11:48:28,943][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [analysis-common] [2023-03-21T11:48:28,944][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [geo] [2023-03-21T11:48:28,944][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [ingest-common] [2023-03-21T11:48:28,945][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [ingest-geoip] [2023-03-21T11:48:28,945][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [ingest-user-agent] [2023-03-21T11:48:28,945][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [kibana] [2023-03-21T11:48:28,946][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [lang-expression] [2023-03-21T11:48:28,946][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [lang-mustache] [2023-03-21T11:48:28,947][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [lang-painless] [2023-03-21T11:48:28,947][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [mapper-extras] [2023-03-21T11:48:28,948][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [parent-join] [2023-03-21T11:48:28,948][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [percolator] [2023-03-21T11:48:28,949][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [rank-eval] [2023-03-21T11:48:28,949][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [reindex] [2023-03-21T11:48:28,950][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [repository-url] [2023-03-21T11:48:28,951][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [tasks] [2023-03-21T11:48:28,951][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded module [transport-netty4] [2023-03-21T11:48:29,040][INFO ][o.e.p.PluginsService ] [onap-sdnrdb-master-0] loaded plugin [repository-s3] [2023-03-21T11:48:30,151][INFO ][o.e.e.NodeEnvironment ] [onap-sdnrdb-master-0] using [1] data paths, mounts [[/bitnami/elasticsearch/data (192.168.5.159:/dockerdata-nfs/onap/elastic-master-0)]], net usable_space [95.2gb], net total_space [99.9gb], types [nfs4] [2023-03-21T11:48:30,153][INFO ][o.e.e.NodeEnvironment ] [onap-sdnrdb-master-0] heap size [123.7mb], compressed ordinary object pointers [true] [2023-03-21T11:48:30,944][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] node name [onap-sdnrdb-master-0], node ID [483FQrbQQCWG4xEhg5RI9g], cluster name [sdnrdb-cluster] [2023-03-21T11:49:29,150][INFO ][o.e.t.NettyAllocator ] [onap-sdnrdb-master-0] creating NettyAllocator with the following configs: [name=unpooled, factors={es.unsafe.use_unpooled_allocator=false, g1gc_enabled=false, g1gc_region_size=0b, heap_size=123.7mb}] [2023-03-21T11:49:29,853][INFO ][o.e.d.DiscoveryModule ] [onap-sdnrdb-master-0] using discovery type [zen] and seed hosts providers [settings] [2023-03-21T11:49:34,442][WARN ][o.e.g.DanglingIndicesState] [onap-sdnrdb-master-0] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually [2023-03-21T11:49:37,250][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] initialized [2023-03-21T11:49:37,341][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] starting ... [2023-03-21T11:49:38,445][INFO ][o.e.m.j.JvmGcMonitorService] [onap-sdnrdb-master-0] [gc][1] overhead, spent [300ms] collecting in the last [1s] [2023-03-21T11:49:39,454][INFO ][o.e.t.TransportService ] [onap-sdnrdb-master-0] publish_address {10.233.69.216:9300}, bound_addresses {0.0.0.0:9300} [2023-03-21T11:49:41,443][INFO ][o.e.b.BootstrapChecks ] [onap-sdnrdb-master-0] bound or publishing to a non-loopback address, enforcing bootstrap checks [2023-03-21T11:49:51,654][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-0] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-0}{483FQrbQQCWG4xEhg5RI9g}{NHD-zOyhSx-VWY6EUTf9Pg}{10.233.69.216}{10.233.69.216:9300}{dmr}]; discovery will continue using [10.233.72.244:9300, 10.233.70.251:9300, 10.233.71.242:9300] from hosts providers and [{onap-sdnrdb-master-0}{483FQrbQQCWG4xEhg5RI9g}{NHD-zOyhSx-VWY6EUTf9Pg}{10.233.69.216}{10.233.69.216:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 [2023-03-21T11:50:01,658][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-0] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-0}{483FQrbQQCWG4xEhg5RI9g}{NHD-zOyhSx-VWY6EUTf9Pg}{10.233.69.216}{10.233.69.216:9300}{dmr}]; discovery will continue using [10.233.72.244:9300, 10.233.70.251:9300, 10.233.71.242:9300] from hosts providers and [{onap-sdnrdb-master-0}{483FQrbQQCWG4xEhg5RI9g}{NHD-zOyhSx-VWY6EUTf9Pg}{10.233.69.216}{10.233.69.216:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 [2023-03-21T11:50:11,661][WARN ][o.e.c.c.ClusterFormationFailureHelper] [onap-sdnrdb-master-0] master not discovered yet, this node has not previously joined a bootstrapped (v7+) cluster, and this node must discover master-eligible nodes [onap-sdnrdb-master-0, onap-sdnrdb-master-1, onap-sdnrdb-master-2] to bootstrap a cluster: have discovered [{onap-sdnrdb-master-0}{483FQrbQQCWG4xEhg5RI9g}{NHD-zOyhSx-VWY6EUTf9Pg}{10.233.69.216}{10.233.69.216:9300}{dmr}]; discovery will continue using [10.233.72.244:9300, 10.233.70.251:9300, 10.233.71.242:9300] from hosts providers and [{onap-sdnrdb-master-0}{483FQrbQQCWG4xEhg5RI9g}{NHD-zOyhSx-VWY6EUTf9Pg}{10.233.69.216}{10.233.69.216:9300}{dmr}] from last-known cluster state; node term 0, last-accepted version 0 in term 0 [2023-03-21T11:50:13,967][INFO ][o.e.c.c.Coordinator ] [onap-sdnrdb-master-0] setting initial configuration to VotingConfiguration{{bootstrap-placeholder}-onap-sdnrdb-master-2,483FQrbQQCWG4xEhg5RI9g,U_yhvesnS2i-RAKDRtpMmw} [2023-03-21T11:50:16,841][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] elected-as-master ([2] nodes joined)[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} elect leader, {onap-sdnrdb-master-0}{483FQrbQQCWG4xEhg5RI9g}{NHD-zOyhSx-VWY6EUTf9Pg}{10.233.69.216}{10.233.69.216:9300}{dmr} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, delta: master node changed {previous [], current [{onap-sdnrdb-master-0}{483FQrbQQCWG4xEhg5RI9g}{NHD-zOyhSx-VWY6EUTf9Pg}{10.233.69.216}{10.233.69.216:9300}{dmr}]}, added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T11:50:18,550][INFO ][o.e.c.c.CoordinationState] [onap-sdnrdb-master-0] cluster UUID set to [PYv3C6XCTMCK0nE4yCOWKg] [2023-03-21T11:50:19,846][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] master node changed {previous [], current [{onap-sdnrdb-master-0}{483FQrbQQCWG4xEhg5RI9g}{NHD-zOyhSx-VWY6EUTf9Pg}{10.233.69.216}{10.233.69.216:9300}{dmr}]}, added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 1, reason: Publication{term=1, version=1} [2023-03-21T11:50:20,343][INFO ][o.e.h.AbstractHttpServerTransport] [onap-sdnrdb-master-0] publish_address {10.233.69.216:9200}, bound_addresses {0.0.0.0:9200} [2023-03-21T11:50:20,343][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader, {onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} join existing leader], term: 1, version: 2, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T11:50:20,344][INFO ][o.e.n.Node ] [onap-sdnrdb-master-0] started [2023-03-21T11:50:21,062][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 2, reason: Publication{term=1, version=2} [2023-03-21T11:50:21,745][INFO ][o.e.g.GatewayService ] [onap-sdnrdb-master-0] recovered [0] indices into cluster_state [2023-03-21T11:50:27,141][INFO ][o.e.c.s.ClusterSettings ] [onap-sdnrdb-master-0] updating [action.auto_create_index] from [true] to [false] [2023-03-21T11:50:30,746][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [historicalperformance24h-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:50:38,543][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 6, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T11:50:41,572][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 6, reason: Publication{term=1, version=6} [2023-03-21T11:50:50,446][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [cmlog-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:51:04,085][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [connectionlog-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:51:12,350][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [networkelement-connection-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:51:20,872][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [mediator-server-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:51:27,242][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [maintenancemode-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:51:33,141][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [guicutthrough-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:51:38,349][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [eventlog-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:51:44,742][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [historicalperformance15min-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:51:52,014][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [inventoryequipment-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:51:58,348][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[inventoryequipment-v7][0], [inventoryequipment-v7][3], [inventoryequipment-v7][4], [inventoryequipment-v7][2]]]). [2023-03-21T11:51:59,061][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [faultcurrent-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:52:05,943][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [faultlog-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:52:11,996][INFO ][o.e.c.m.MetadataCreateIndexService] [onap-sdnrdb-master-0] [userdata-v7] creating index, cause [api], templates [], shards [5]/[1] [2023-03-21T11:52:18,595][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[userdata-v7][3], [userdata-v7][4], [userdata-v7][2], [userdata-v7][0]]]). [2023-03-21T12:50:12,446][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 90, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T12:50:17,589][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 90, reason: Publication{term=1, version=90} [2023-03-21T12:50:18,141][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [connectionlog-v7][2] primary-replica resync completed with 0 operations [2023-03-21T12:50:18,448][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [userdata-v7][2] primary-replica resync completed with 0 operations [2023-03-21T12:50:18,642][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [guicutthrough-v7][2] primary-replica resync completed with 0 operations [2023-03-21T12:50:18,846][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [cmlog-v7][2] primary-replica resync completed with 0 operations [2023-03-21T12:50:19,041][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [53.3s] (43 delayed shards) [2023-03-21T12:50:19,049][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [mediator-server-v7][2] primary-replica resync completed with 0 operations [2023-03-21T12:50:19,444][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} reason: disconnected], term: 1, version: 91, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T12:50:19,640][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [inventoryequipment-v7][2] primary-replica resync completed with 0 operations [2023-03-21T12:50:20,096][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 91, reason: Publication{term=1, version=91} [2023-03-21T12:50:20,141][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 92, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T12:50:20,684][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 92, reason: Publication{term=1, version=92} [2023-03-21T12:50:20,840][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 93, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T12:50:21,285][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 93, reason: Publication{term=1, version=93} [2023-03-21T12:50:21,291][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 94, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T12:50:21,901][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 94, reason: Publication{term=1, version=94} [2023-03-21T12:50:22,042][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 95, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T12:50:22,393][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 95, reason: Publication{term=1, version=95} [2023-03-21T12:50:22,396][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} join existing leader], term: 1, version: 96, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T12:50:22,709][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 96, reason: Publication{term=1, version=96} [2023-03-21T12:50:22,979][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 97, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T12:50:24,991][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 97, reason: Publication{term=1, version=97} [2023-03-21T12:50:37,442][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 110, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T12:50:40,900][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 110, reason: Publication{term=1, version=110} [2023-03-21T12:50:41,072][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [inventoryequipment-v7][4] primary-replica resync completed with 0 operations [2023-03-21T12:50:41,241][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [networkelement-connection-v7][2] primary-replica resync completed with 0 operations [2023-03-21T12:50:41,363][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [mediator-server-v7][4] primary-replica resync completed with 0 operations [2023-03-21T12:50:41,460][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [faultlog-v7][2] primary-replica resync completed with 0 operations [2023-03-21T12:50:41,652][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [faultcurrent-v7][3] primary-replica resync completed with 0 operations [2023-03-21T12:50:41,843][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [faultcurrent-v7][0] primary-replica resync completed with 0 operations [2023-03-21T12:50:41,871][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [guicutthrough-v7][4] primary-replica resync completed with 0 operations [2023-03-21T12:50:42,342][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [eventlog-v7][0] primary-replica resync completed with 0 operations [2023-03-21T12:50:42,448][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [eventlog-v7][3] primary-replica resync completed with 0 operations [2023-03-21T12:50:42,451][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [historicalperformance15min-v7][2] primary-replica resync completed with 0 operations [2023-03-21T12:50:42,569][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [maintenancemode-v7][3] primary-replica resync completed with 0 operations [2023-03-21T12:50:42,673][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [maintenancemode-v7][0] primary-replica resync completed with 0 operations [2023-03-21T12:50:42,687][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 111, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T12:50:42,854][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [connectionlog-v7][4] primary-replica resync completed with 0 operations [2023-03-21T12:50:42,952][INFO ][o.e.i.s.IndexShard ] [onap-sdnrdb-master-0] [userdata-v7][4] primary-replica resync completed with 0 operations [2023-03-21T12:50:42,955][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 111, reason: Publication{term=1, version=111} [2023-03-21T12:50:43,142][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 112, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T12:50:44,454][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 112, reason: Publication{term=1, version=112} [2023-03-21T12:50:45,659][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 114, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T12:50:45,946][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 114, reason: Publication{term=1, version=114} [2023-03-21T12:50:46,244][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 115, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T12:50:46,768][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 115, reason: Publication{term=1, version=115} [2023-03-21T12:50:47,712][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 117, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T12:50:48,055][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 117, reason: Publication{term=1, version=117} [2023-03-21T12:50:48,255][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 118, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T12:50:50,355][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 118, reason: Publication{term=1, version=118} [2023-03-21T12:50:50,361][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 119, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T12:50:51,064][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 119, reason: Publication{term=1, version=119} [2023-03-21T12:50:51,110][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 120, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T12:50:51,541][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 120, reason: Publication{term=1, version=120} [2023-03-21T12:50:54,444][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 123, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T12:50:56,427][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 123, reason: Publication{term=1, version=123} [2023-03-21T12:51:01,198][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[connectionlog-v7][1], [cmlog-v7][3], [cmlog-v7][0]]]). [2023-03-21T12:51:14,744][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [22.3s] (18 delayed shards) [2023-03-21T12:51:56,602][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[historicalperformance24h-v7][0]]]). [2023-03-21T13:00:27,884][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-0] invalid internal transport message format, got (4a,44,57,50), [Netty4TcpChannel{localAddress=/127.0.0.1:9300, remoteAddress=/127.0.0.1:42732}], closing connection [2023-03-21T13:24:20,240][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-0] invalid internal transport message format, got (4a,44,57,50), [Netty4TcpChannel{localAddress=/127.0.0.1:9300, remoteAddress=/127.0.0.1:35732}], closing connection [2023-03-21T13:49:17,294][WARN ][o.e.t.TcpTransport ] [onap-sdnrdb-master-0] invalid internal transport message format, got (4a,44,57,50), [Netty4TcpChannel{localAddress=/127.0.0.1:9300, remoteAddress=/127.0.0.1:60704}], closing connection [2023-03-21T13:50:21,624][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} reason: disconnected], term: 1, version: 194, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T13:50:21,728][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 194, reason: Publication{term=1, version=194} [2023-03-21T13:50:22,913][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 195, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T13:50:25,929][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 195, reason: Publication{term=1, version=195} [2023-03-21T13:50:25,932][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [56.9s] (43 delayed shards) [2023-03-21T13:50:25,934][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} join existing leader, {onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 196, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r},{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T13:50:26,205][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r},{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 196, reason: Publication{term=1, version=196} [2023-03-21T13:50:26,441][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 197, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T13:50:26,670][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 197, reason: Publication{term=1, version=197} [2023-03-21T13:50:26,673][WARN ][o.e.c.c.Coordinator ] [onap-sdnrdb-master-0] failed to validate incoming join request from node [{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}] org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-1][10.233.71.242:9300][internal:cluster/coordination/join/validate] disconnected [2023-03-21T13:50:27,569][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 198, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T13:50:29,310][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 198, reason: Publication{term=1, version=198} [2023-03-21T13:50:51,849][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 232, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T13:50:54,788][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 232, reason: Publication{term=1, version=232} [2023-03-21T13:50:55,541][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 234, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T13:50:56,942][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 234, reason: Publication{term=1, version=234} [2023-03-21T13:51:03,122][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[networkelement-connection-v7][0], [historicalperformance24h-v7][3], [historicalperformance24h-v7][1]]]). [2023-03-21T13:51:23,988][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [27.7s] (13 delayed shards) [2023-03-21T13:51:46,130][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[historicalperformance24h-v7][0]]]). [2023-03-21T14:50:24,442][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} reason: disconnected], term: 1, version: 304, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T14:50:24,660][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 304, reason: Publication{term=1, version=304} [2023-03-21T14:50:27,469][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} join existing leader], term: 1, version: 305, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T14:50:27,688][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 305, reason: Publication{term=1, version=305} [2023-03-21T14:50:27,742][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 306, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T14:50:29,923][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 306, reason: Publication{term=1, version=306} [2023-03-21T14:50:29,925][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.7s] (43 delayed shards) [2023-03-21T14:50:30,965][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 307, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T14:50:32,486][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 307, reason: Publication{term=1, version=307} [2023-03-21T14:50:55,642][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 345, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T14:50:57,564][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 345, reason: Publication{term=1, version=345} [2023-03-21T14:50:59,066][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 347, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T14:51:00,654][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 347, reason: Publication{term=1, version=347} [2023-03-21T14:51:07,507][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[historicalperformance24h-v7][3], [cmlog-v7][3], [cmlog-v7][0]]]). [2023-03-21T14:51:28,792][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [26.7s] (9 delayed shards) [2023-03-21T14:51:42,891][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[historicalperformance24h-v7][0]]]). [2023-03-21T14:54:45,138][INFO ][o.e.m.j.JvmGcMonitorService] [onap-sdnrdb-master-0] [gc][11099] overhead, spent [292ms] collecting in the last [1s] [2023-03-21T15:50:27,385][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} reason: disconnected], term: 1, version: 418, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T15:50:27,663][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 418, reason: Publication{term=1, version=418} [2023-03-21T15:50:30,333][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} join existing leader], term: 1, version: 419, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T15:50:30,547][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 419, reason: Publication{term=1, version=419} [2023-03-21T15:50:30,879][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 420, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T15:50:32,667][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 420, reason: Publication{term=1, version=420} [2023-03-21T15:50:32,672][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [58.2s] (43 delayed shards) [2023-03-21T15:50:33,668][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 421, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T15:50:35,289][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 421, reason: Publication{term=1, version=421} [2023-03-21T15:50:57,879][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 461, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T15:51:00,498][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 461, reason: Publication{term=1, version=461} [2023-03-21T15:51:01,217][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 464, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T15:51:02,559][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 464, reason: Publication{term=1, version=464} [2023-03-21T15:51:10,541][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[historicalperformance24h-v7][1]]]). [2023-03-21T15:51:31,318][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [26.5s] (9 delayed shards) [2023-03-21T15:51:43,384][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[historicalperformance24h-v7][1]]]). [2023-03-21T16:50:30,312][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} reason: disconnected], term: 1, version: 532, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T16:50:30,421][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 532, reason: Publication{term=1, version=532} [2023-03-21T16:50:33,381][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} join existing leader], term: 1, version: 533, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T16:50:33,539][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 533, reason: Publication{term=1, version=533} [2023-03-21T16:50:33,648][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 534, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T16:50:36,157][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 534, reason: Publication{term=1, version=534} [2023-03-21T16:50:36,161][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.4s] (43 delayed shards) [2023-03-21T16:50:36,658][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 536, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T16:50:38,238][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 536, reason: Publication{term=1, version=536} [2023-03-21T16:51:01,000][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 575, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T16:51:04,259][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 575, reason: Publication{term=1, version=575} [2023-03-21T16:51:05,081][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 577, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T16:51:05,246][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 577, reason: Publication{term=1, version=577} [2023-03-21T16:51:05,353][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 578, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T16:51:06,286][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 578, reason: Publication{term=1, version=578} [2023-03-21T16:51:07,677][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 580, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T16:51:07,842][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 580, reason: Publication{term=1, version=580} [2023-03-21T16:51:07,876][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 581, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T16:51:08,072][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 581, reason: Publication{term=1, version=581} [2023-03-21T16:51:09,363][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 583, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T16:51:10,687][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 583, reason: Publication{term=1, version=583} [2023-03-21T16:51:15,170][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[historicalperformance24h-v7][1], [historicalperformance24h-v7][3]]]). [2023-03-21T16:51:35,856][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [25.1s] (16 delayed shards) [2023-03-21T16:51:56,326][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[historicalperformance24h-v7][1]]]). [2023-03-21T17:50:33,353][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} reason: disconnected], term: 1, version: 653, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T17:50:33,533][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 653, reason: Publication{term=1, version=653} [2023-03-21T17:50:36,456][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} join existing leader], term: 1, version: 655, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T17:50:36,638][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 655, reason: Publication{term=1, version=655} [2023-03-21T17:50:36,654][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 656, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T17:50:39,389][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 656, reason: Publication{term=1, version=656} [2023-03-21T17:50:39,392][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.2s] (43 delayed shards) [2023-03-21T17:50:39,393][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 657, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T17:50:39,604][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 657, reason: Publication{term=1, version=657} [2023-03-21T17:50:39,640][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 658, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T17:50:39,749][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 658, reason: Publication{term=1, version=658} [2023-03-21T17:50:39,754][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 659, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T17:50:39,973][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 659, reason: Publication{term=1, version=659} [2023-03-21T17:50:40,001][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 660, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T17:50:40,174][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 660, reason: Publication{term=1, version=660} [2023-03-21T17:50:40,759][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 661, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T17:50:42,091][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 661, reason: Publication{term=1, version=661} [2023-03-21T17:51:08,897][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 700, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T17:51:11,660][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 700, reason: Publication{term=1, version=700} [2023-03-21T17:51:11,665][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 701, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T17:51:12,259][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 701, reason: Publication{term=1, version=701} [2023-03-21T17:51:12,297][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 702, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T17:51:13,776][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 702, reason: Publication{term=1, version=702} [2023-03-21T17:51:14,291][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 704, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T17:51:14,456][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 704, reason: Publication{term=1, version=704} [2023-03-21T17:51:14,488][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 705, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T17:51:14,718][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 705, reason: Publication{term=1, version=705} [2023-03-21T17:51:15,969][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 708, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T17:51:17,527][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 708, reason: Publication{term=1, version=708} [2023-03-21T17:51:20,302][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[cmlog-v7][0], [maintenancemode-v7][4]]]). [2023-03-21T17:51:37,430][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [31.4s] (12 delayed shards) [2023-03-21T17:51:52,863][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[historicalperformance24h-v7][3]]]). [2023-03-21T18:50:36,426][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} reason: disconnected], term: 1, version: 781, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T18:50:36,545][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 781, reason: Publication{term=1, version=781} [2023-03-21T18:50:38,541][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} join existing leader], term: 1, version: 782, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T18:50:38,703][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 782, reason: Publication{term=1, version=782} [2023-03-21T18:50:40,731][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 783, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T18:50:43,304][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 783, reason: Publication{term=1, version=783} [2023-03-21T18:50:43,306][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.4s] (43 delayed shards) [2023-03-21T18:50:43,663][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 784, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T18:50:45,282][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 784, reason: Publication{term=1, version=784} [2023-03-21T18:51:15,642][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 842, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T18:51:19,353][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 842, reason: Publication{term=1, version=842} [2023-03-21T18:51:19,356][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 843, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T18:51:19,554][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 843, reason: Publication{term=1, version=843} [2023-03-21T18:51:19,646][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 844, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T18:51:20,504][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 844, reason: Publication{term=1, version=844} [2023-03-21T18:51:20,508][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 845, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T18:51:20,764][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 845, reason: Publication{term=1, version=845} [2023-03-21T18:51:20,792][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 846, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T18:51:20,910][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 846, reason: Publication{term=1, version=846} [2023-03-21T18:51:20,914][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[historicalperformance24h-v7][4], [historicalperformance24h-v7][2], [historicalperformance24h-v7][1], [historicalperformance24h-v7][3], [cmlog-v7][0]]]). [2023-03-21T18:51:21,794][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 848, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T18:51:23,167][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 848, reason: Publication{term=1, version=848} [2023-03-21T18:51:41,452][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [34.1s] (14 delayed shards) [2023-03-21T18:51:57,835][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[historicalperformance24h-v7][1]]]). [2023-03-21T19:50:38,499][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} reason: disconnected], term: 1, version: 918, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T19:50:38,619][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 918, reason: Publication{term=1, version=918} [2023-03-21T19:50:41,506][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} join existing leader], term: 1, version: 919, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T19:50:41,705][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 919, reason: Publication{term=1, version=919} [2023-03-21T19:50:43,571][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 920, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T19:50:45,714][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 920, reason: Publication{term=1, version=920} [2023-03-21T19:50:45,717][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.8s] (43 delayed shards) [2023-03-21T19:50:45,804][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 921, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T19:50:47,587][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 921, reason: Publication{term=1, version=921} [2023-03-21T19:51:22,021][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 981, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T19:51:24,465][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 981, reason: Publication{term=1, version=981} [2023-03-21T19:51:25,390][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 984, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T19:51:26,989][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 984, reason: Publication{term=1, version=984} [2023-03-21T19:51:26,993][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[historicalperformance24h-v7][1], [historicalperformance24h-v7][3]]]). [2023-03-21T19:51:44,123][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [37.8s] (17 delayed shards) [2023-03-21T19:52:04,203][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[historicalperformance24h-v7][1]]]). [2023-03-21T20:50:41,485][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} reason: disconnected], term: 1, version: 1055, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T20:50:41,626][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 1055, reason: Publication{term=1, version=1055} [2023-03-21T20:50:44,571][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} join existing leader], term: 1, version: 1056, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T20:50:44,747][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 1056, reason: Publication{term=1, version=1056} [2023-03-21T20:50:45,802][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 1057, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T20:50:47,765][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 1057, reason: Publication{term=1, version=1057} [2023-03-21T20:50:47,767][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [58s] (43 delayed shards) [2023-03-21T20:50:48,789][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 1058, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T20:50:50,027][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 1058, reason: Publication{term=1, version=1058} [2023-03-21T20:51:24,959][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 1120, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T20:51:29,130][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 1120, reason: Publication{term=1, version=1120} [2023-03-21T20:51:29,489][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 1122, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T20:51:29,693][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 1122, reason: Publication{term=1, version=1122} [2023-03-21T20:51:29,726][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 1123, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T20:51:30,383][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 1123, reason: Publication{term=1, version=1123} [2023-03-21T20:51:30,388][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 1124, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T20:51:30,722][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 1124, reason: Publication{term=1, version=1124} [2023-03-21T20:51:30,759][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 1125, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T20:51:31,050][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 1125, reason: Publication{term=1, version=1125} [2023-03-21T20:51:31,052][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[historicalperformance24h-v7][1], [historicalperformance24h-v7][3]]]). [2023-03-21T20:51:31,051][WARN ][o.e.c.c.Coordinator ] [onap-sdnrdb-master-0] failed to validate incoming join request from node [{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}] org.elasticsearch.transport.NodeDisconnectedException: [onap-sdnrdb-master-2][10.233.70.251:9300][internal:cluster/coordination/join/validate] disconnected [2023-03-21T20:51:32,049][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 1127, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T20:51:33,389][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 1127, reason: Publication{term=1, version=1127} [2023-03-21T20:51:46,344][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [38.6s] (24 delayed shards) [2023-03-21T20:52:10,314][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[historicalperformance24h-v7][1]]]). [2023-03-21T21:50:44,542][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} reason: disconnected], term: 1, version: 1196, delta: removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T21:50:44,647][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 1196, reason: Publication{term=1, version=1196} [2023-03-21T21:50:47,600][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r} join existing leader], term: 1, version: 1197, delta: added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}} [2023-03-21T21:50:47,753][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-coordinating-only-54c85fc557-g9ncr}{vZNn6r6kRHyfyDE4L_1YiA}{UPUaZWnxTD6Zfn7HDPY98w}{10.233.72.244}{10.233.72.244:9300}{r}}, term: 1, version: 1197, reason: Publication{term=1, version=1197} [2023-03-21T21:50:48,767][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 1198, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T21:50:51,700][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 1198, reason: Publication{term=1, version=1198} [2023-03-21T21:50:51,704][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57s] (43 delayed shards) [2023-03-21T21:50:51,705][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 1199, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T21:50:51,949][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 1199, reason: Publication{term=1, version=1199} [2023-03-21T21:50:52,142][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} reason: disconnected], term: 1, version: 1200, delta: removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T21:50:52,249][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 1200, reason: Publication{term=1, version=1200} [2023-03-21T21:50:52,616][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr} join existing leader], term: 1, version: 1201, delta: added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}} [2023-03-21T21:50:55,139][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-1}{U_yhvesnS2i-RAKDRtpMmw}{Bh7bpHVoQIC7MbIxwYjHqQ}{10.233.71.242}{10.233.71.242:9300}{dmr}}, term: 1, version: 1201, reason: Publication{term=1, version=1201} [2023-03-21T21:51:25,172][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[historicalperformance24h-v7][3]]]). [2023-03-21T21:51:31,973][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-left[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} reason: disconnected], term: 1, version: 1268, delta: removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T21:51:34,159][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] removed {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 1268, reason: Publication{term=1, version=1268} [2023-03-21T21:51:34,161][INFO ][o.e.c.r.DelayedAllocationService] [onap-sdnrdb-master-0] scheduling reroute for delayed shards in [57.8s] (43 delayed shards) [2023-03-21T21:51:34,972][INFO ][o.e.c.s.MasterService ] [onap-sdnrdb-master-0] node-join[{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr} join existing leader], term: 1, version: 1269, delta: added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}} [2023-03-21T21:51:36,301][INFO ][o.e.c.s.ClusterApplierService] [onap-sdnrdb-master-0] added {{onap-sdnrdb-master-2}{rMotoWCKQouj0wC84rH0Rg}{t46xUV7jTIeDWF-Pgp65Xw}{10.233.70.251}{10.233.70.251:9300}{dmr}}, term: 1, version: 1269, reason: Publication{term=1, version=1269} [2023-03-21T21:52:06,857][INFO ][o.e.c.r.a.AllocationService] [onap-sdnrdb-master-0] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[historicalperformance24h-v7][1]]]).