By type
OpenDistro for Elasticsearch Security Demo Installer ** Warning: Do not use on production or public reachable systems ** Basedir: /usr/share/elasticsearch Elasticsearch install type: rpm/deb on CentOS Linux release 7.7.1908 (Core) Elasticsearch config dir: /usr/share/elasticsearch/config Elasticsearch config file: /usr/share/elasticsearch/config/elasticsearch.yml Elasticsearch bin dir: /usr/share/elasticsearch/bin Elasticsearch plugins dir: /usr/share/elasticsearch/plugins Elasticsearch lib dir: /usr/share/elasticsearch/lib Detected Elasticsearch Version: x-content-7.3.2 Detected Open Distro Security Version: 1.3.0.0 /usr/share/elasticsearch/config/elasticsearch.yml seems to be already configured for Security. Quit. OpenJDK 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release. [2021-05-27T02:37:40,453][WARN ][o.e.d.c.s.Settings ] [cldash-es-node1] [transport.tcp.port] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version. [2021-05-27T02:37:40,765][WARN ][o.e.d.c.s.Settings ] [cldash-es-node1] [node.max_local_storage_nodes] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version. [2021-05-27T02:37:40,989][INFO ][o.e.e.NodeEnvironment ] [cldash-es-node1] using [1] data paths, mounts [[/usr/share/elasticsearch/data (10.253.0.174:/dockerdata-nfs/onap/clamp/dashboard-elasticsearch/data)]], net usable_space [93.5gb], net total_space [99.9gb], types [nfs4] [2021-05-27T02:37:40,990][INFO ][o.e.e.NodeEnvironment ] [cldash-es-node1] heap size [1015.6mb], compressed ordinary object pointers [true] [2021-05-27T02:37:41,044][INFO ][o.e.n.Node ] [cldash-es-node1] node name [cldash-es-node1], node ID [ftdKAcrMRUiwHZjyhUaWew], cluster name [clamp-dashboard] [2021-05-27T02:37:41,045][INFO ][o.e.n.Node ] [cldash-es-node1] version[7.3.2], pid[1], build[oss/tar/1c1faf1/2019-09-06T14:40:30.409026Z], OS[Linux/4.9.0-14-amd64/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/11.0.1/11.0.1+13] [2021-05-27T02:37:41,045][INFO ][o.e.n.Node ] [cldash-es-node1] JVM home [/opt/jdk-11.0.1] [2021-05-27T02:37:41,046][INFO ][o.e.n.Node ] [cldash-es-node1] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch-16896023646595037019, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Djava.locale.providers=COMPAT, -Djava.security.policy=file:///usr/share/elasticsearch/plugins/opendistro_performance_analyzer/pa_config/es_security.policy, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Des.cgroups.hierarchy.override=/, -Dio.netty.allocator.type=unpooled, -XX:MaxDirectMemorySize=536870912, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=oss, -Des.distribution.type=tar, -Des.bundled_jdk=true] [2021-05-27T02:37:43,948][INFO ][c.a.o.e.p.c.PluginSettings] [cldash-es-node1] Config: metricsLocation: /dev/shm/performanceanalyzer/, metricsDeletionInterval: 1, httpsEnabled: false, cleanup-metrics-db-files: true [2021-05-27T02:37:44,461][INFO ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] ES Config path is /usr/share/elasticsearch/config [2021-05-27T02:37:44,653][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] OpenSSL not available (this is not an error, we simply fallback to built-in JDK SSL) because of java.lang.ClassNotFoundException: io.netty.internal.tcnative.SSL [2021-05-27T02:37:45,143][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] JVM supports TLSv1.3 [2021-05-27T02:37:45,144][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] Config directory is /usr/share/elasticsearch/config/, from there the key- and truststore files are resolved relatively [2021-05-27T02:37:47,647][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] TLS Transport Client Provider : JDK [2021-05-27T02:37:47,648][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] TLS Transport Server Provider : JDK [2021-05-27T02:37:47,648][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] TLS HTTP Provider : JDK [2021-05-27T02:37:47,648][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] Enabled TLS protocols for transport layer : [TLSv1.3, TLSv1.2, TLSv1.1] [2021-05-27T02:37:47,648][INFO ][c.a.o.s.s.DefaultOpenDistroSecurityKeyStore] [cldash-es-node1] Enabled TLS protocols for HTTP layer : [TLSv1.3, TLSv1.2, TLSv1.1] [2021-05-27T02:37:48,467][INFO ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] Clustername: clamp-dashboard [2021-05-27T02:37:48,570][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] Directory /usr/share/elasticsearch/config has insecure file permissions (should be 0700) [2021-05-27T02:37:48,571][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/elasticsearch.yml has insecure file permissions (should be 0600) [2021-05-27T02:37:48,571][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/log4j2.properties has insecure file permissions (should be 0600) [2021-05-27T02:37:48,571][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/org.onap.clamp.crt.key has insecure file permissions (should be 0600) [2021-05-27T02:37:48,571][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/org.onap.clamp.key.pem has insecure file permissions (should be 0600) [2021-05-27T02:37:48,571][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/clamp-ca-certs.pem has insecure file permissions (should be 0600) [2021-05-27T02:37:48,571][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/kirk-key.pem has insecure file permissions (should be 0600) [2021-05-27T02:37:48,572][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/kirk.pem has insecure file permissions (should be 0600) [2021-05-27T02:37:48,572][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/esnode-key.pem has insecure file permissions (should be 0600) [2021-05-27T02:37:48,572][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/esnode.pem has insecure file permissions (should be 0600) [2021-05-27T02:37:48,572][WARN ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] File /usr/share/elasticsearch/config/root-ca.pem has insecure file permissions (should be 0600) [2021-05-27T02:37:49,156][INFO ][c.a.o.j.JobSchedulerPlugin] [cldash-es-node1] Loaded scheduler extension: opendistro-managed-index, index: .opendistro-ism-config [2021-05-27T02:37:49,280][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [aggs-matrix-stats] [2021-05-27T02:37:49,280][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [analysis-common] [2021-05-27T02:37:49,281][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [ingest-common] [2021-05-27T02:37:49,281][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [ingest-geoip] [2021-05-27T02:37:49,281][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [ingest-user-agent] [2021-05-27T02:37:49,281][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [lang-expression] [2021-05-27T02:37:49,281][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [lang-mustache] [2021-05-27T02:37:49,281][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [lang-painless] [2021-05-27T02:37:49,281][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [mapper-extras] [2021-05-27T02:37:49,281][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [parent-join] [2021-05-27T02:37:49,281][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [percolator] [2021-05-27T02:37:49,281][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [rank-eval] [2021-05-27T02:37:49,282][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [reindex] [2021-05-27T02:37:49,282][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [repository-url] [2021-05-27T02:37:49,282][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded module [transport-netty4] [2021-05-27T02:37:49,282][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro-job-scheduler] [2021-05-27T02:37:49,282][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro_alerting] [2021-05-27T02:37:49,283][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro_index_management] [2021-05-27T02:37:49,283][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro_performance_analyzer] [2021-05-27T02:37:49,283][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro_security] [2021-05-27T02:37:49,283][INFO ][o.e.p.PluginsService ] [cldash-es-node1] loaded plugin [opendistro_sql] [2021-05-27T02:37:49,348][INFO ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] Disabled https compression by default to mitigate BREACH attacks. You can enable it by setting 'http.compression: true' in elasticsearch.yml [2021-05-27T02:37:55,852][WARN ][o.e.d.c.s.Settings ] [cldash-es-node1] [discovery.zen.minimum_master_nodes] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version. [2021-05-27T02:37:58,156][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Configured categories on rest layer to ignore: [AUTHENTICATED, GRANTED_PRIVILEGES] [2021-05-27T02:37:58,157][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Configured categories on transport layer to ignore: [AUTHENTICATED, GRANTED_PRIVILEGES] [2021-05-27T02:37:58,157][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Configured Users to ignore: [kibanaserver] [2021-05-27T02:37:58,158][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Configured Users to ignore for read compliance events: [kibanaserver] [2021-05-27T02:37:58,158][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Configured Users to ignore for write compliance events: [kibanaserver] [2021-05-27T02:37:58,545][INFO ][c.a.o.s.a.i.AuditLogImpl ] [cldash-es-node1] Message routing enabled: true [2021-05-27T02:37:58,549][WARN ][c.a.o.s.c.ComplianceConfig] [cldash-es-node1] If you plan to use field masking pls configure opendistro_security.compliance.salt to be a random string of 16 chars length identical on all nodes [2021-05-27T02:37:58,549][INFO ][c.a.o.s.c.ComplianceConfig] [cldash-es-node1] PII configuration [auditLogPattern=org.joda.time.format.DateTimeFormatter@de0c402, auditLogIndex=null]: {} [2021-05-27T02:37:59,880][INFO ][o.e.d.DiscoveryModule ] [cldash-es-node1] using discovery type [zen] and seed hosts providers [settings] [2021-05-27T02:38:01,239][INFO ][c.a.o.e.p.h.c.PerformanceAnalyzerConfigAction] [cldash-es-node1] PerformanceAnalyzer Enabled: true [2021-05-27T02:38:01,351][INFO ][o.e.n.Node ] [cldash-es-node1] initialized [2021-05-27T02:38:01,351][INFO ][o.e.n.Node ] [cldash-es-node1] starting ... [2021-05-27T02:38:01,864][INFO ][o.e.t.TransportService ] [cldash-es-node1] publish_address {10.233.75.195:9300}, bound_addresses {0.0.0.0:9300} [2021-05-27T02:38:01,949][INFO ][o.e.b.BootstrapChecks ] [cldash-es-node1] bound or publishing to a non-loopback address, enforcing bootstrap checks [2021-05-27T02:38:02,038][INFO ][o.e.c.c.Coordinator ] [cldash-es-node1] setting initial configuration to VotingConfiguration{ftdKAcrMRUiwHZjyhUaWew} [2021-05-27T02:38:03,036][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector MasterServiceMetrics is still in progress, so skipping this Interval [2021-05-27T02:38:03,039][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector HeapMetrics is still in progress, so skipping this Interval [2021-05-27T02:38:03,039][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector NetworkE2ECollector is still in progress, so skipping this Interval [2021-05-27T02:38:03,039][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector NetworkInterfaceCollector is still in progress, so skipping this Interval [2021-05-27T02:38:03,039][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector ThreadPoolMetrics is still in progress, so skipping this Interval [2021-05-27T02:38:03,040][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector NodeDetails is still in progress, so skipping this Interval [2021-05-27T02:38:03,040][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector OSMetrics is still in progress, so skipping this Interval [2021-05-27T02:38:03,040][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector NodeStatsMetrics is still in progress, so skipping this Interval [2021-05-27T02:38:03,040][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector CircuitBreaker is still in progress, so skipping this Interval [2021-05-27T02:38:03,048][INFO ][o.e.c.s.MasterService ] [cldash-es-node1] elected-as-master ([1] nodes joined)[{cldash-es-node1}{ftdKAcrMRUiwHZjyhUaWew}{tYb6zZQ7Tc2vY_c0PTf7iw}{10.233.75.195}{10.233.75.195:9300}{dim} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 1, version: 1, reason: master node changed {previous [], current [{cldash-es-node1}{ftdKAcrMRUiwHZjyhUaWew}{tYb6zZQ7Tc2vY_c0PTf7iw}{10.233.75.195}{10.233.75.195:9300}{dim}]} [2021-05-27T02:38:03,442][INFO ][o.e.c.c.CoordinationState] [cldash-es-node1] cluster UUID set to [0dFGXiqaTEKNjUHcbyxDGQ] WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.amazon.opendistro.elasticsearch.performanceanalyzer.collectors.MasterServiceEventMetrics (file:/usr/share/elasticsearch/plugins/opendistro_performance_analyzer/opendistro_performance_analyzer-1.3.0.0.jar) to field java.util.concurrent.ThreadPoolExecutor.workers WARNING: Please consider reporting this to the maintainers of com.amazon.opendistro.elasticsearch.performanceanalyzer.collectors.MasterServiceEventMetrics WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release [2021-05-27T02:38:03,642][INFO ][o.e.c.s.ClusterApplierService] [cldash-es-node1] master node changed {previous [], current [{cldash-es-node1}{ftdKAcrMRUiwHZjyhUaWew}{tYb6zZQ7Tc2vY_c0PTf7iw}{10.233.75.195}{10.233.75.195:9300}{dim}]}, term: 1, version: 1, reason: Publication{term=1, version=1} [2021-05-27T02:38:04,037][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector MasterServiceEventMetrics is still in progress, so skipping this Interval [2021-05-27T02:38:04,037][INFO ][c.a.o.e.p.c.ScheduledMetricCollectorsExecutor] [cldash-es-node1] Collector OSMetrics is still in progress, so skipping this Interval [2021-05-27T02:38:04,136][INFO ][o.e.h.AbstractHttpServerTransport] [cldash-es-node1] publish_address {10.233.75.195:9200}, bound_addresses {0.0.0.0:9200} [2021-05-27T02:38:04,136][INFO ][o.e.n.Node ] [cldash-es-node1] started [2021-05-27T02:38:04,137][INFO ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] Node started [2021-05-27T02:38:04,137][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Check if .opendistro_security index exists ... [2021-05-27T02:38:04,138][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] .opendistro_security index does not exist yet, so we create a default config [2021-05-27T02:38:04,139][INFO ][c.a.o.s.OpenDistroSecurityPlugin] [cldash-es-node1] 4 Open Distro Security modules loaded so far: [Module [type=DLSFLS, implementing class=com.amazon.opendistroforelasticsearch.security.configuration.OpenDistroSecurityFlsDlsIndexSearcherWrapper], Module [type=AUDITLOG, implementing class=com.amazon.opendistroforelasticsearch.security.auditlog.impl.AuditLogImpl], Module [type=MULTITENANCY, implementing class=com.amazon.opendistroforelasticsearch.security.configuration.PrivilegesInterceptorImpl], Module [type=REST_MANAGEMENT_API, implementing class=com.amazon.opendistroforelasticsearch.security.dlic.rest.api.OpenDistroSecurityRestApiActions]] [2021-05-27T02:38:04,139][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Background init thread started. Install default config?: true [2021-05-27T02:38:04,144][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Will create .opendistro_security index so we can apply default config [2021-05-27T02:38:04,357][INFO ][o.e.g.GatewayService ] [cldash-es-node1] recovered [0] indices into cluster_state [2021-05-27T02:38:04,747][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.opendistro_security] creating index, cause [api], templates [], shards [1]/[1], mappings [] [2021-05-27T02:38:04,758][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] updating number_of_replicas to [0] for indices [.opendistro_security] [2021-05-27T02:38:05,727][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.opendistro_security][0]] ...]). [2021-05-27T02:38:05,858][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Index .opendistro_security created?: true [2021-05-27T02:38:05,859][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'CONFIG' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/config.yml [2021-05-27T02:38:06,663][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/BqBTvF8_QJGFML7z2BFjsw] create_mapping [_doc] [2021-05-27T02:38:07,165][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'ROLES' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/roles.yml [2021-05-27T02:38:07,237][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/BqBTvF8_QJGFML7z2BFjsw] update_mapping [_doc] [2021-05-27T02:38:07,546][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'ROLESMAPPING' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/roles_mapping.yml [2021-05-27T02:38:07,569][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/BqBTvF8_QJGFML7z2BFjsw] update_mapping [_doc] [2021-05-27T02:38:07,843][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'INTERNALUSERS' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/internal_users.yml [2021-05-27T02:38:07,875][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/BqBTvF8_QJGFML7z2BFjsw] update_mapping [_doc] [2021-05-27T02:38:08,292][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'ACTIONGROUPS' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/action_groups.yml [2021-05-27T02:38:08,350][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/BqBTvF8_QJGFML7z2BFjsw] update_mapping [_doc] [2021-05-27T02:38:08,757][INFO ][c.a.o.s.s.ConfigHelper ] [cldash-es-node1] Will update 'TENANTS' with /usr/share/elasticsearch/plugins/opendistro_security/securityconfig/tenants.yml [2021-05-27T02:38:08,778][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.opendistro_security/BqBTvF8_QJGFML7z2BFjsw] update_mapping [_doc] [2021-05-27T02:38:09,241][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Default config applied [2021-05-27T02:38:09,567][INFO ][c.a.o.s.c.ConfigurationRepository] [cldash-es-node1] Node 'cldash-es-node1' initialized [2021-05-27T02:43:01,960][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T02:44:58,374][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [security-auditlog-2021.05.27] creating index, cause [auto(bulk api)], templates [], shards [1]/[1], mappings [] [2021-05-27T02:44:58,839][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [security-auditlog-2021.05.27/AJAZD3F1TTu3zaJbjB04YA] create_mapping [_doc] [2021-05-27T02:47:00,360][INFO ][o.e.c.m.MetaDataIndexTemplateService] [cldash-es-node1] adding template [logstash] for index patterns [logstash-*] [2021-05-27T02:47:00,561][INFO ][o.e.c.m.MetaDataIndexTemplateService] [cldash-es-node1] adding template [logstash] for index patterns [logstash-*] [2021-05-27T02:48:01,963][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T02:48:07,927][WARN ][o.e.d.a.b.BulkRequestParser] [cldash-es-node1] [types removal] Specifying types in bulk requests is deprecated. [2021-05-27T02:48:07,956][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [errors-2021.05.147] creating index, cause [auto(bulk api)], templates [], shards [1]/[1], mappings [] [2021-05-27T02:48:08,362][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [errors-2021.05.147/ifT78EvEQfig5tJVe-lSmQ] create_mapping [_doc] [2021-05-27T02:48:08,490][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [errors-2021.05.147/ifT78EvEQfig5tJVe-lSmQ] update_mapping [_doc] [2021-05-27T02:49:32,156][INFO ][o.e.c.m.MetaDataIndexTemplateService] [cldash-es-node1] adding template [tenant_template] for index patterns [.kibana_-*_*, .kibana_0*_*, .kibana_1*_*, .kibana_2*_*, .kibana_3*_*, .kibana_4*_*, .kibana_5*_*, .kibana_6*_*, .kibana_7*_*, .kibana_8*_*, .kibana_9*_*] [2021-05-27T02:49:32,347][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc] [2021-05-27T02:49:32,349][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] updating number_of_replicas to [0] for indices [.kibana_1] [2021-05-27T02:49:33,647][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [security-auditlog-2021.05.27/AJAZD3F1TTu3zaJbjB04YA] update_mapping [_doc] [2021-05-27T02:49:38,269][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.kibana_-1404856460_clampadmin] creating index, cause [auto(bulk api)], templates [tenant_template], shards [1]/[1], mappings [_doc] [2021-05-27T02:49:38,663][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin/rTXukB39SBa-MwM5HVAjFw] update_mapping [_doc] [2021-05-27T02:49:42,089][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin/rTXukB39SBa-MwM5HVAjFw] update_mapping [_doc] [2021-05-27T02:49:51,838][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin/rTXukB39SBa-MwM5HVAjFw] update_mapping [_doc] [2021-05-27T02:50:01,377][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin/rTXukB39SBa-MwM5HVAjFw] update_mapping [_doc] [2021-05-27T02:50:11,385][INFO ][o.e.c.m.MetaDataIndexTemplateService] [cldash-es-node1] adding template [tenant_template] for index patterns [.kibana_-*_*, .kibana_0*_*, .kibana_1*_*, .kibana_2*_*, .kibana_3*_*, .kibana_4*_*, .kibana_5*_*, .kibana_6*_*, .kibana_7*_*, .kibana_8*_*, .kibana_9*_*] [2021-05-27T02:50:11,964][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_2] creating index, cause [api], templates [tenant_template], shards [1]/[1], mappings [_doc] [2021-05-27T02:50:11,964][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] updating number_of_replicas to [0] for indices [.kibana_-1404856460_clampadmin_2] [2021-05-27T02:50:12,480][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_1] creating index, cause [api], templates [tenant_template], shards [1]/[1], mappings [_doc] [2021-05-27T02:50:12,480][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] updating number_of_replicas to [0] for indices [.kibana_-1404856460_clampadmin_1] [2021-05-27T02:50:13,556][INFO ][o.e.c.m.MetaDataCreateIndexService] [cldash-es-node1] [.tasks] creating index, cause [auto(task api)], templates [], shards [1]/[1], mappings [task] [2021-05-27T02:50:13,556][INFO ][o.e.c.r.a.AllocationService] [cldash-es-node1] updating number_of_replicas to [0] for indices [.tasks] [2021-05-27T02:50:13,887][INFO ][o.e.t.LoggingTaskListener] [cldash-es-node1] 406 finished with response BulkByScrollResponse[took=642ms,timed_out=false,sliceId=null,updated=0,created=20,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]] [2021-05-27T02:50:14,247][INFO ][o.e.c.m.MetaDataDeleteIndexService] [cldash-es-node1] [.kibana_-1404856460_clampadmin/rTXukB39SBa-MwM5HVAjFw] deleting index [2021-05-27T02:50:14,749][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_2/0S-3YlEdSgKcHvX-Gtor6A] update_mapping [_doc] [2021-05-27T02:50:14,945][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_2/0S-3YlEdSgKcHvX-Gtor6A] update_mapping [_doc] [2021-05-27T02:50:15,074][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_2/0S-3YlEdSgKcHvX-Gtor6A] update_mapping [_doc] [2021-05-27T02:50:15,262][INFO ][o.e.c.m.MetaDataMappingService] [cldash-es-node1] [.kibana_-1404856460_clampadmin_2/0S-3YlEdSgKcHvX-Gtor6A] update_mapping [_doc] [2021-05-27T02:53:01,964][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T02:58:01,965][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:03:01,966][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:08:01,967][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:13:01,967][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:18:01,968][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:23:01,969][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:28:01,970][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:33:01,970][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:38:01,971][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:43:01,972][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:48:01,973][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:53:01,974][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T03:58:01,975][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:03:01,975][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:08:01,976][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:13:01,977][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:18:01,978][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:23:01,979][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:28:01,979][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:33:01,980][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:38:01,981][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:43:01,982][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:48:01,982][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:53:01,983][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep [2021-05-27T04:58:01,984][INFO ][c.a.o.j.s.JobSweeper ] [cldash-es-node1] Running full sweep