OpenDistro for Elasticsearch Security Demo Installer ** Warning: Do not use on production or public reachable systems ** Basedir: /usr/share/elasticsearch Elasticsearch install type: rpm/deb on CentOS Linux release 7.7.1908 (Core) Elasticsearch config dir: /usr/share/elasticsearch/config Elasticsearch config file: /usr/share/elasticsearch/config/elasticsearch.yml Elasticsearch bin dir: /usr/share/elasticsearch/bin Elasticsearch plugins dir: /usr/share/elasticsearch/plugins Elasticsearch lib dir: /usr/share/elasticsearch/lib Detected Elasticsearch Version: x-content-7.3.2 Detected Open Distro Security Version: 1.3.0.0 /usr/share/elasticsearch/config/elasticsearch.yml seems to be already configured for Security. Quit. OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. [2021-05-30T02:12:53,172][WARN ][o.e.d.c.s.Settings ] [cldash-es-node1] [transport.tcp.port] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version. [2021-05-30T02:12:53,460][WARN ][o.e.d.c.s.Settings ] [cldash-es-node1] [node.max_local_storage_nodes] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version. [2021-05-30T02:12:53,776][INFO ][o.e.e.NodeEnvironment ] [cldash-es-node1] using [1] data paths, mounts [[/usr/share/elasticsearch/data (10.253.0.167:/dockerdata-nfs/onap/clamp/dashboard-elasticsearch/data)]], net usable_space [94.2gb], net total_space [99.9gb], types [nfs4] [2021-05-30T02:12:53,776][INFO ][o.e.e.NodeEnvironment ] [cldash-es-node1] heap size [1015.6mb], compressed ordinary object pointers [true] [2021-05-30T02:12:53,786][INFO ][o.e.n.Node ] [cldash-es-node1] node name [cldash-es-node1], node ID [ly9C3B5OSV2ie9z3-ReGeA], cluster name [clamp-dashboard] [2021-05-30T02:12:53,786][INFO ][o.e.n.Node ] [cldash-es-node1] version[7.3.2], pid[1], build[oss/tar/1c1faf1/2019-09-06T14:40:30.409026Z], OS[Linux/4.9.0-14-amd64/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/11.0.1/11.0.1+13] [2021-05-30T02:12:53,787][INFO ][o.e.n.Node ] [cldash-es-node1] JVM home [/opt/jdk-11.0.1] [2021-05-30T02:12:53,787][INFO ][o.e.n.Node ] [cldash-es-node1] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-11040966967564034897, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Djava.security.policy=file:///usr/share/elasticsearch/plugins/opendistro_performance_analyzer/pa_config/es_security.policy, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Des.cgroups.hierarchy.override=/, -Dio.netty.allocator.type=unpooled, -XX:MaxDirectMemorySize=536870912, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=oss, -Des.distribution.type=tar, -Des.bundled_jdk=true] [2021-05-30T02:12:56,872][INFO ][c.a.o.e.p.c.PluginSettings] [cldash-es-node1] Config: metricsLocation: /dev/shm/performanceanalyzer/, metricsDeletionInterval: 1, httpsEnabled: false, cleanup-metrics-db-files: true [2021-05-30T02:12:57,299][INFO ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] ES Config path is /usr/share/elasticsearch/config [2021-05-30T02:12:57,483][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] OpenSSL not available (this is not an error, we simply fallback to built-in JDK SSL) because of java.lang.ClassNotFoundException: io.netty.internal.tcnative.SSL [2021-05-30T02:12:57,869][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] JVM supports TLSv1.3 [2021-05-30T02:12:57,870][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] Config directory is /usr/share/elasticsearch/config/, from there the key- and truststore files are resolved relatively [2021-05-30T02:12:59,288][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] TLS Transport Client Provider : JDK [2021-05-30T02:12:59,288][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] TLS Transport Server Provider : JDK [2021-05-30T02:12:59,288][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] TLS HTTP Provider : JDK [2021-05-30T02:12:59,288][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] Enabled TLS protocols for transport layer : [TLSv1.3, TLSv1.2, TLSv1.1] [2021-05-30T02:12:59,289][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] Enabled TLS protocols for HTTP layer : [TLSv1.3, TLSv1.2, TLSv1.1] [2021-05-30T02:12:59,971][INFO ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] Clustername: clamp-dashboard [2021-05-30T02:13:00,077][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] Directory /usr/share/elasticsearch/config has insecure file permissions (should be 0700) [2021-05-30T02:13:00,078][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/elasticsearch.yml has insecure file permissions (should be 0600) [2021-05-30T02:13:00,078][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/log4j2.properties has insecure file permissions (should be 0600) [2021-05-30T02:13:00,078][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/org.onap.clamp.crt.key has insecure file permissions (should be 0600) [2021-05-30T02:13:00,078][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/org.onap.clamp.key.pem has insecure file permissions (should be 0600) [2021-05-30T02:13:00,078][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/clamp-ca-certs.pem has insecure file permissions (should be 0600) [2021-05-30T02:13:00,079][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/kirk-key.pem has insecure file permissions (should be 0600) [2021-05-30T02:13:00,079][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/kirk.pem has insecure file permissions (should be 0600) [2021-05-30T02:13:00,079][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/esnode-key.pem has insecure file permissions (should be 0600) [2021-05-30T02:13:00,079][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/esnode.pem has insecure file permissions (should be 0600) [2021-05-30T02:13:00,079][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/root-ca.pem has insecure file permissions (should be 0600) [2021-05-30T02:13:00,598][INFO ][c.a.o.j.JobSchedulerPlugin] [cldash-es-node1] Loaded scheduler extension: opendistro-managed-index, index: .opendistro-ism-config [2021-05-30T02:13:00,770][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [aggs-matrix-stats] [2021-05-30T02:13:00,770][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [analysis-common] [2021-05-30T02:13:00,770][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [ingest-common] [2021-05-30T02:13:00,770][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [ingest-geoip] [2021-05-30T02:13:00,770][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [ingest-user-agent] [2021-05-30T02:13:00,771][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [lang-expression] [2021-05-30T02:13:00,771][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [lang-mustache] [2021-05-30T02:13:00,771][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [lang-painless] [2021-05-30T02:13:00,771][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [mapper-extras] [2021-05-30T02:13:00,771][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [parent-join] [2021-05-30T02:13:00,771][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [percolator] [2021-05-30T02:13:00,771][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [rank-eval] [2021-05-30T02:13:00,771][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [reindex] [2021-05-30T02:13:00,772][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [repository-url] [2021-05-30T02:13:00,772][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [transport-netty4] [2021-05-30T02:13:00,772][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro-job-scheduler] [2021-05-30T02:13:00,772][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro_alerting] [2021-05-30T02:13:00,772][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro_index_management] [2021-05-30T02:13:00,773][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro_performance_analyzer] [2021-05-30T02:13:00,773][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro_security] [2021-05-30T02:13:00,773][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro_sql] [2021-05-30T02:13:00,789][INFO ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] Disabled https compression by default to mitigate BREACH attacks. You can enable it by setting 'http.compression: true' in elasticsearch.yml [2021-05-30T02:13:07,479][WARN ][o.e.d.c.s.Settings ] [cldash-es-node1] [discovery.zen.minimum_master_nodes] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version. [2021-05-30T02:13:10,475][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Configured categories on rest layer to ignore: [AUTHENTICATED, GRANTED_PRIVILEGES] [2021-05-30T02:13:10,476][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Configured categories on transport layer to ignore: [AUTHENTICATED, GRANTED_PRIVILEGES] [2021-05-30T02:13:10,476][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Configured Users to ignore: [kibanaserver] [2021-05-30T02:13:10,477][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Configured Users to ignore for read compliance events: [kibanaserver] [2021-05-30T02:13:10,477][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Configured Users to ignore for write compliance events: [kibanaserver] [2021-05-30T02:13:11,173][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Message routing enabled: true [2021-05-30T02:13:11,179][WARN ][c.a.o.s.c.ComplianceConfig] [cldash-es-node1] If you plan to use field masking pls configure opendistro_security.compliance.salt to be a random string of 16 chars length identical on all nodes [2021-05-30T02:13:11,179][INFO ][c.a.o.s.c.ComplianceConfig] [cldash-es-node1] PII configuration [auditLogPattern=org.joda.time.format.DateTimeFormatter@416d90f0, auditLogIndex=null]: {} [2021-05-30T02:13:12,773][INFO ][o.e.d.DiscoveryModule ] [cldash-es-node1] using discovery type [zen] and seed hosts providers [settings] [2021-05-30T02:13:14,064][INFO ][c.a.o.e.p.h.c.PerformanceAnalyzerConfigAction] [cldash-es-node1] PerformanceAnalyzer Enabled: true [2021-05-30T02:13:14,170][INFO ][o.e.n.Node ] [cldash-es-node1] initialized [2021-05-30T02:13:14,170][INFO ][o.e.n.Node ] [cldash-es-node1] starting ... [2021-05-30T02:13:14,466][INFO ][o.e.t.TransportService ] [cldash-es-node1] publish_address {10.233.74.152:9300}, bound_addresses {0.0.0.0:9300} [2021-05-30T02:13:14,478][INFO ][o.e.b.BootstrapChecks ] [cldash-es-node1] bound or publishing to a non-loopback address, enforcing bootstrap checks [2021-05-30T02:13:14,498][INFO ][o.e.c.c.Coordinator ] [cldash-es-node1] setting initial configuration to VotingConfiguration{ly9C3B5OSV2ie9z3-ReGeA} [2021-05-30T02:13:14,768][INFO ][o.e.c.s.MasterService ] [cldash-es-node1] elected-as-master ([1] nodes joined)[{cldash-es-node1}{ly9C3B5OSV2ie9z3-ReGeA}{3YfLwrjjSN2RySqypRtPkA}{10.233.74.152}{10.233.74.152:9300}{dim} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, reason: master node changed {previous [], current [{cldash-es-node1}{ly9C3B5OSV2ie9z3-ReGeA}{3YfLwrjjSN2RySqypRtPkA}{10.233.74.152}{10.233.74.152:9300}{dim}]} [2021-05-30T02:13:14,816][INFO ][o.e.c.c.CoordinationState] [cldash-es-node1] cluster UUID set to [zcGPJVLqQCKb4tnVHUHFKQ] [2021-05-30T02:13:14,860][INFO ][o.e.c.s.ClusterApplierService] [cldash-es-node1] master node changed {previous [], current [{cldash-es-node1}{ly9C3B5OSV2ie9z3-ReGeA}{3YfLwrjjSN2RySqypRtPkA}{10.233.74.152}{10.233.74.152:9300}{dim}]}, term: 1, version: 1, reason: Publication{term=1, version=1} [2021-05-30T02:13:15,067][INFO ][o.e.h.AbstractHttpServerTransport] [cldash-es-node1] publish_address {10.233.74.152:9200}, bound_addresses {0.0.0.0:9200} [2021-05-30T02:13:15,067][INFO ][o.e.n.Node ] [cldash-es-node1] started [2021-05-30T02:13:15,068][INFO ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] Node started [2021-05-30T02:13:15,068][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Check if .opendistro_security index exists ... [2021-05-30T02:13:15,068][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] .opendistro_security index does not exist yet, so we create a default config [2021-05-30T02:13:15,068][INFO ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] 4 Open Distro Security modules loaded so far: [Module [type=DLSFLS, implementing class=com.amazon.opendistroforelasticsearch.security.configuration.OpenDistroSecurityFlsDlsIndexSearcherWrapper], Module [type=AUDITLOG, implementing class=com.amazon.opendistroforelasticsearch.security.auditlog.impl.AuditLogImpl], Module [type=REST_MANAGEMENT_API, implementing class=com.amazon.opendistroforelasticsearch.security.dlic.rest.api.OpenDistroSecurityRestApiActions], Module [type=MULTITENANCY, implementing class=com.amazon.opendistroforelasticsearch.security.configuration.PrivilegesInterceptorImpl]] [2021-05-30T02:13:15,069][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Background init thread started. Install default config?: true [2021-05-30T02:13:15,076][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Will create .opendistro_security index so we can apply default config [2021-05-30T02:13:15,264][INFO ][o.e.g.GatewayService ] [cldash-es-node1] recovered [0] indices into cluster_state [2021-05-30T02:13:15,565][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.opendistro_security] creating index, cause [api], templates [], shards [1]/[1], mappings [] [2021-05-30T02:13:15,577][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] updating number_of_replicas to [0] for indices [.opendistro_security] WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.amazon.opendistro.elasticsearch.performanceanalyzer.collectors.MasterServiceEventMetrics (file:/usr/share/elasticsearch/plugins/opendistro_performance_analyzer/opendistro_performance_analyzer-1.3.0.0.jar) to field java.util.concurrent.ThreadPoolExecutor.workers WARNING: Please consider reporting this to the maintainers of com.amazon.opendistro.elasticsearch.performanceanalyzer.collectors.MasterServiceEventMetrics WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release [2021-05-30T02:13:15,991][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector MasterServiceEventMetrics is still in progress, so skipping this Interval [2021-05-30T02:13:15,992][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector OSMetrics is still in progress, so skipping this Interval [2021-05-30T02:13:16,890][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.opendistro_security][0]] ...]). [2021-05-30T02:13:17,075][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Index .opendistro_security created?: true [2021-05-30T02:13:17,076][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'CONFIG' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/config.yml [2021-05-30T02:13:17,578][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/oZjuCgZqTN6ANXUtDoxCpg] create_mapping [_doc] [2021-05-30T02:13:18,181][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'ROLES' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/roles.yml [2021-05-30T02:13:18,262][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/oZjuCgZqTN6ANXUtDoxCpg] update_mapping [_doc] [2021-05-30T02:13:18,481][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'ROLESMAPPING' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/roles_mapping.yml [2021-05-30T02:13:18,502][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/oZjuCgZqTN6ANXUtDoxCpg] update_mapping [_doc] [2021-05-30T02:13:18,829][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'INTERNALUSERS' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/internal_users.yml [2021-05-30T02:13:18,850][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/oZjuCgZqTN6ANXUtDoxCpg] update_mapping [_doc] [2021-05-30T02:13:19,063][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'ACTIONGROUPS' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/action_groups.yml [2021-05-30T02:13:19,080][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/oZjuCgZqTN6ANXUtDoxCpg] update_mapping [_doc] [2021-05-30T02:13:19,391][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'TENANTS' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/tenants.yml [2021-05-30T02:13:19,405][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/oZjuCgZqTN6ANXUtDoxCpg] update_mapping [_doc] [2021-05-30T02:13:19,566][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Default config applied [2021-05-30T02:13:19,874][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Node 'cldash-es-node1' initialized [2021-05-30T02:18:14,489][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-30T02:20:09,570][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [security-auditlog-2021.05.30] creating index, cause [auto(bulk api)], templates [], shards [1]/[1], mappings [] [2021-05-30T02:20:09,867][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [security-auditlog-2021.05.30/hLOC3ugJTP-hABSShgA1lw] create_mapping [_doc] [2021-05-30T02:23:14,491][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-30T02:23:59,073][INFO ][o.e.c.m.MetaDataIndexTemplateService] [cldash-es-node1] adding template [tenant_template] for index patterns [.kibana_-*_*, .kibana_0*_*, .kibana_1*_*, .kibana_2*_*, .kibana_3*_*, .kibana_4*_*, .kibana_5*_*, .kibana_6*_*, .kibana_7*_*, .kibana_8*_*, .kibana_9*_*] [2021-05-30T02:23:59,260][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc] [2021-05-30T02:23:59,261][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] updating number_of_replicas to [0] for indices [.kibana_1] [2021-05-30T02:24:00,090][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [security-auditlog-2021.05.30/hLOC3ugJTP-hABSShgA1lw] update_mapping [_doc] [2021-05-30T02:24:04,730][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.kibana_-1404856460_clampadmin] creating index, cause [auto(bulk api)], templates [tenant_template], shards [1]/[1], mappings [_doc] [2021-05-30T02:24:04,941][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin/xmas0jHuSpGOoggswi4laQ] update_mapping [_doc] [2021-05-30T02:24:08,297][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin/xmas0jHuSpGOoggswi4laQ] update_mapping [_doc] [2021-05-30T02:24:17,477][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin/xmas0jHuSpGOoggswi4laQ] update_mapping [_doc] [2021-05-30T02:24:26,341][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin/xmas0jHuSpGOoggswi4laQ] update_mapping [_doc] [2021-05-30T02:24:37,083][INFO ][o.e.c.m.MetaDataIndexTemplateService] [cldash-es-node1] adding template [tenant_template] for index patterns [.kibana_-*_*, .kibana_0*_*, .kibana_1*_*, .kibana_2*_*, .kibana_3*_*, .kibana_4*_*, .kibana_5*_*, .kibana_6*_*, .kibana_7*_*, .kibana_8*_*, .kibana_9*_*] [2021-05-30T02:24:37,498][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_2] creating index, cause [api], templates [tenant_template], shards [1]/[1], mappings [_doc] [2021-05-30T02:24:37,499][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] updating number_of_replicas to [0] for indices [.kibana_-1404856460_clampadmin_2] [2021-05-30T02:24:37,881][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_1] creating index, cause [api], templates [tenant_template], shards [1]/[1], mappings [_doc] [2021-05-30T02:24:37,882][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] updating number_of_replicas to [0] for indices [.kibana_-1404856460_clampadmin_1] [2021-05-30T02:24:38,659][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.tasks] creating index, cause [auto(task api)], templates [], shards [1]/[1], mappings [task] [2021-05-30T02:24:38,660][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] updating number_of_replicas to [0] for indices [.tasks] [2021-05-30T02:24:38,914][INFO ][o.e.t.LoggingTaskListener] [cldash-es-node1] 343 finished with response BulkByScrollResponse[took=430.2ms,timed_out=false,sliceId=null,updated=0,created=20,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]] [2021-05-30T02:24:39,134][INFO ][o.e.c.m.MetaDataDeleteIndexService] [cldash-es-node1] [.kibana_-1404856460_clampadmin/xmas0jHuSpGOoggswi4laQ] deleting index [2021-05-30T02:24:39,561][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_2/6hI758FwSqyHPqmvuqb-EQ] update_mapping [_doc] [2021-05-30T02:24:39,671][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_2/6hI758FwSqyHPqmvuqb-EQ] update_mapping [_doc] [2021-05-30T02:24:39,864][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_2/6hI758FwSqyHPqmvuqb-EQ] update_mapping [_doc] [2021-05-30T02:24:39,973][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_2/6hI758FwSqyHPqmvuqb-EQ] update_mapping [_doc] [2021-05-30T02:28:14,492][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-30T02:31:02,566][INFO ][o.e.c.m.MetaDataIndexTemplateService] [cldash-es-node1] adding template [logstash] for index patterns [logstash-*] [2021-05-30T02:31:02,602][INFO ][o.e.c.m.MetaDataIndexTemplateService] [cldash-es-node1] adding template [logstash] for index patterns [logstash-*] [2021-05-30T02:31:02,674][INFO ][o.e.c.m.MetaDataIndexTemplateService] [cldash-es-node1] adding template [logstash] for index patterns [logstash-*] [2021-05-30T02:32:10,367][WARN ][o.e.d.a.b.BulkRequestParser] [cldash-es-node1] [types removal] Specifying types in bulk requests is deprecated. [2021-05-30T02:32:10,378][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [errors-2021.05.150] creating index, cause [auto(bulk api)], templates [], shards [1]/[1], mappings [] [2021-05-30T02:32:10,714][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [errors-2021.05.150/avczPWm2Sg-OR_vD_lPpXw] create_mapping [_doc] [2021-05-30T02:32:10,793][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [errors-2021.05.150/avczPWm2Sg-OR_vD_lPpXw] update_mapping [_doc] [2021-05-30T02:33:14,492][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-30T02:38:14,493][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-30T02:43:14,494][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-30T02:48:14,494][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-30T02:53:14,495][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-30T02:58:14,495][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-30T03:03:14,496][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep