2021/10/21 15:15:13.887087 beat.go:285: INFO Home path: [/usr/share/filebeat] Config path: [/usr/share/filebeat] Data path: [/usr/share/filebeat/data] Logs path: [/usr/share/filebeat/logs] 2021/10/21 15:15:13.887135 beat.go:186: INFO Setup Beat: filebeat; Version: 5.5.0 2021/10/21 15:15:13.887151 processor.go:44: DBG Processors: 2021/10/21 15:15:13.887166 beat.go:192: DBG Initializing output plugins 2021/10/21 15:15:13.887284 logstash.go:90: INFO Max Retries set to: 3 2021/10/21 15:15:13.887353 outputs.go:108: INFO Activated logstash as output plugin. 2021/10/21 15:15:13.887369 publish.go:238: DBG Create output worker 2021/10/21 15:15:13.887425 publish.go:280: DBG No output is defined to store the topology. The server fields might not be filled. 2021/10/21 15:15:13.887487 publish.go:295: INFO Publisher name: sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector 2021/10/21 15:15:13.887690 async.go:63: INFO Flush Interval set to: 1s 2021/10/21 15:15:13.887702 async.go:64: INFO Max Bulk Size set to: 2048 2021/10/21 15:15:13.887710 async.go:72: DBG create bulk processing worker (interval=1s, bulk size=2048) 2021/10/21 15:15:13.888251 beat.go:221: INFO filebeat start running. 2021/10/21 15:15:13.888300 metrics.go:23: INFO Metrics logging every 30s 2021/10/21 15:15:13.888327 registrar.go:68: INFO No registry file found under: /usr/share/filebeat/data/registry. Creating a new registry file. 2021/10/21 15:15:13.888341 registrar.go:298: DBG Write registry file: /usr/share/filebeat/data/registry 2021/10/21 15:15:13.914320 registrar.go:323: DBG Registry file updated. 0 states written. 2021/10/21 15:15:13.914401 registrar.go:106: INFO Loading registrar data from /usr/share/filebeat/data/registry 2021/10/21 15:15:13.914433 registrar.go:123: INFO States Loaded from registrar: 0 2021/10/21 15:15:13.914577 registrar.go:236: INFO Starting Registrar 2021/10/21 15:15:13.914592 crawler.go:38: INFO Loading Prospectors: 1 2021/10/21 15:15:13.914631 sync.go:41: INFO Start sending events to output 2021/10/21 15:15:13.914773 spooler.go:63: INFO Starting spooler: spool_size: 2048; idle_timeout: 5s 2021/10/21 15:15:13.914777 prospector.go:83: DBG File Configs: [/var/log/onap/*/*/*/*.log /var/log/onap/*/*/*.log /var/log/onap/*/*.log] 2021/10/21 15:15:13.914833 prospector_log.go:44: DBG exclude_files: [] 2021/10/21 15:15:13.914849 prospector_log.go:65: INFO Prospector with previous states loaded: 0 2021/10/21 15:15:13.914994 prospector.go:124: INFO Starting prospector of type: log; id: 12576369028753478767 2021/10/21 15:15:13.915041 crawler.go:58: INFO Loading and starting Prospectors completed. Enabled prospectors: 1 2021/10/21 15:15:13.915073 prospector_log.go:70: DBG Start next scan 2021/10/21 15:15:13.915356 prospector_log.go:91: DBG Prospector states cleaned up. Before: 0, After: 0 2021/10/21 15:15:18.915156 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:15:23.915565 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:15:23.915664 prospector.go:183: DBG Run prospector 2021/10/21 15:15:23.915682 prospector_log.go:70: DBG Start next scan 2021/10/21 15:15:23.916142 prospector_log.go:91: DBG Prospector states cleaned up. Before: 0, After: 0 2021/10/21 15:15:28.915844 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:15:33.916113 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:15:33.916484 prospector.go:183: DBG Run prospector 2021/10/21 15:15:33.916507 prospector_log.go:70: DBG Start next scan 2021/10/21 15:15:33.916841 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:15:33.916871 prospector_log.go:245: DBG Start harvester for new file: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:15:33.917086 state.go:64: DBG New state added for /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:15:33.917204 log.go:288: DBG Setting offset for file based on seek: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:15:33.917238 log.go:273: DBG Setting offset for file: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log. Offset: 0 2021/10/21 15:15:33.917324 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/21 15:15:33.917398 log.go:91: INFO Harvester started for file: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:15:33.917453 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:15:34.918307 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:15:36.918838 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:15:38.916458 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 1 2021/10/21 15:15:38.916552 client.go:158: DBG No events to publish 2021/10/21 15:15:38.916568 sync.go:70: DBG Events sent: 1 2021/10/21 15:15:38.916582 registrar.go:275: DBG Processing 1 events 2021/10/21 15:15:38.916595 state.go:64: DBG New state added for /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:15:38.916607 registrar.go:261: DBG Registrar states cleaned up. Before: 1, After: 1 2021/10/21 15:15:38.916614 registrar.go:298: DBG Write registry file: /usr/share/filebeat/data/registry 2021/10/21 15:15:38.966202 registrar.go:323: DBG Registry file updated. 1 states written. 2021/10/21 15:15:40.919159 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:15:43.888717 metrics.go:39: INFO Non-zero metrics in the last 30s: filebeat.harvester.open_files=1 filebeat.harvester.running=1 filebeat.harvester.started=1 publish.events=1 registrar.states.current=1 registrar.states.update=1 registrar.writes=2 2021/10/21 15:15:43.916790 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:15:43.917610 prospector.go:183: DBG Run prospector 2021/10/21 15:15:43.917633 prospector_log.go:70: DBG Start next scan 2021/10/21 15:15:43.918149 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:15:43.918178 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log, offset: 0 2021/10/21 15:15:43.918187 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:15:43.918197 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/21 15:15:48.917091 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:15:48.919473 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:15:53.917365 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:15:53.918435 prospector.go:183: DBG Run prospector 2021/10/21 15:15:53.918655 prospector_log.go:70: DBG Start next scan 2021/10/21 15:15:53.919101 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:15:53.919200 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log, offset: 0 2021/10/21 15:15:53.919237 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:15:53.919285 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/21 15:15:58.917688 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:15:58.920096 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:15:59.920783 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:16:01.921159 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:16:03.917995 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 3 2021/10/21 15:16:03.918298 client.go:214: DBG Publish: { "@timestamp": "2021-10-21T15:15:58.919Z", "beat": { "hostname": "sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector", "name": "sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector", "version": "5.5.0" }, "input_type": "log", "message": "org.onap.dcaegen2.services.sdk.services.common.FileReader |2021-10-21T15:15:57.276Z |ERROR |Error while reading file. Filename: /app-config/application_config.yaml |RequestID=e4bf2e97-9f4b-4bf1-8774-44c5205b66f3 | | |main |", "offset": 256, "source": "/var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log", "type": "log" } 2021/10/21 15:16:03.918377 client.go:214: DBG Publish: { "@timestamp": "2021-10-21T15:15:58.919Z", "beat": { "hostname": "sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector", "name": "sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector", "version": "5.5.0" }, "input_type": "log", "message": "org.onap.dcaegen2.services.sdk.rest.services.cbs.client.impl.CbsClientConfigMap |2021-10-21T15:15:57.291Z |ERROR |Error loading configuration from configMap file: Expected a com.google.gson.JsonObject but was com.google.gson.JsonNull |RequestID=e4bf2e97-9f4b-4bf1-8774-44c5205b66f3 | | |main |", "offset": 582, "source": "/var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log", "type": "log" } 2021/10/21 15:16:03.918430 client.go:214: DBG Publish: { "@timestamp": "2021-10-21T15:15:58.920Z", "beat": { "hostname": "sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector", "name": "sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector", "version": "5.5.0" }, "input_type": "log", "message": "org.onap.dcaegen2.collectors.datafile.tasks.ScheduledTasks |2021-10-21T15:15:57.691Z |WARN |No configuration loaded, skipping polling for messages | | | |pool-2-thread-1 |", "offset": 786, "source": "/var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log", "type": "log" } 2021/10/21 15:16:03.918461 output.go:109: DBG output worker: publish 3 events 2021/10/21 15:16:03.918469 sync.go:53: DBG connect 2021/10/21 15:16:03.919505 prospector.go:183: DBG Run prospector 2021/10/21 15:16:03.919537 prospector_log.go:70: DBG Start next scan 2021/10/21 15:16:03.919863 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:16:03.919881 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log, offset: 786 2021/10/21 15:16:03.919890 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:16:03.919901 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/21 15:16:03.935757 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:03.935790 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:03.935801 single.go:156: DBG send fail 2021/10/21 15:16:04.936112 sync.go:53: DBG connect 2021/10/21 15:16:04.943443 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:04.943476 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:04.943486 single.go:156: DBG send fail 2021/10/21 15:16:05.922023 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:16:06.943828 sync.go:53: DBG connect 2021/10/21 15:16:06.949986 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:06.950020 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:06.950033 single.go:156: DBG send fail 2021/10/21 15:16:08.919305 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:16:10.950288 sync.go:53: DBG connect 2021/10/21 15:16:10.960152 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:10.960194 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:10.960211 single.go:156: DBG send fail 2021/10/21 15:16:13.888887 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.publisher.published_events=3 2021/10/21 15:16:13.919702 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:16:13.920191 prospector.go:183: DBG Run prospector 2021/10/21 15:16:13.920225 prospector_log.go:70: DBG Start next scan 2021/10/21 15:16:13.921151 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:16:13.921191 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log, offset: 786 2021/10/21 15:16:13.921200 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:16:13.921211 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/21 15:16:13.922269 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:16:18.920025 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:16:18.960511 sync.go:53: DBG connect 2021/10/21 15:16:19.020571 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:19.020622 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:19.020634 single.go:156: DBG send fail 2021/10/21 15:16:23.920359 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:16:23.921424 prospector.go:183: DBG Run prospector 2021/10/21 15:16:23.921454 prospector_log.go:70: DBG Start next scan 2021/10/21 15:16:23.921867 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:16:23.921909 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log, offset: 786 2021/10/21 15:16:23.921916 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:16:23.921923 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/21 15:16:23.922567 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:16:28.920767 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:16:33.921091 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/21 15:16:33.922147 prospector.go:183: DBG Run prospector 2021/10/21 15:16:33.922174 prospector_log.go:70: DBG Start next scan 2021/10/21 15:16:33.922673 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:16:33.922721 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log, offset: 786 2021/10/21 15:16:33.922736 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log 2021/10/21 15:16:33.922748 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/21 15:16:33.923006 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:16:34.923511 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:16:35.020965 sync.go:53: DBG connect 2021/10/21 15:16:35.030823 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:35.030868 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/21 15:16:35.030876 single.go:156: DBG send fail 2021/10/21 15:16:35.923897 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:16:37.924291 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now. 2021/10/21 15:16:38.921545 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 8 2021/10/21 15:16:41.924801 log_file.go:84: DBG End of file reached: /var/log/onap/sed6ee78ed08b47eb87bcb187a42b98a1-datafile-collector/application.log; Backoff now.