By type
2021/10/15 16:26:57.337376 beat.go:285: INFO Home path: [/usr/share/filebeat] Config path: [/usr/share/filebeat] Data path: [/usr/share/filebeat/data] Logs path: [/usr/share/filebeat/logs] 2021/10/15 16:26:57.337422 beat.go:186: INFO Setup Beat: filebeat; Version: 5.5.0 2021/10/15 16:26:57.337434 processor.go:44: DBG Processors: 2021/10/15 16:26:57.337445 beat.go:192: DBG Initializing output plugins 2021/10/15 16:26:57.337548 logstash.go:90: INFO Max Retries set to: 3 2021/10/15 16:26:57.337653 outputs.go:108: INFO Activated logstash as output plugin. 2021/10/15 16:26:57.337682 publish.go:238: DBG Create output worker 2021/10/15 16:26:57.337729 publish.go:280: DBG No output is defined to store the topology. The server fields might not be filled. 2021/10/15 16:26:57.337578 metrics.go:23: INFO Metrics logging every 30s 2021/10/15 16:26:57.337792 publish.go:295: INFO Publisher name: s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector 2021/10/15 16:26:57.337968 async.go:63: INFO Flush Interval set to: 1s 2021/10/15 16:26:57.337986 async.go:64: INFO Max Bulk Size set to: 2048 2021/10/15 16:26:57.337993 async.go:72: DBG create bulk processing worker (interval=1s, bulk size=2048) 2021/10/15 16:26:57.338447 beat.go:221: INFO filebeat start running. 2021/10/15 16:26:57.338559 registrar.go:68: INFO No registry file found under: /usr/share/filebeat/data/registry. Creating a new registry file. 2021/10/15 16:26:57.338586 registrar.go:298: DBG Write registry file: /usr/share/filebeat/data/registry 2021/10/15 16:26:57.547940 registrar.go:323: DBG Registry file updated. 0 states written. 2021/10/15 16:26:57.548042 registrar.go:106: INFO Loading registrar data from /usr/share/filebeat/data/registry 2021/10/15 16:26:57.548089 registrar.go:123: INFO States Loaded from registrar: 0 2021/10/15 16:26:57.548193 crawler.go:38: INFO Loading Prospectors: 1 2021/10/15 16:26:57.548337 registrar.go:236: INFO Starting Registrar 2021/10/15 16:26:57.548433 sync.go:41: INFO Start sending events to output 2021/10/15 16:26:57.548440 prospector.go:83: DBG File Configs: [/var/log/onap/*/*/*/*.log /var/log/onap/*/*/*.log /var/log/onap/*/*.log] 2021/10/15 16:26:57.548482 prospector_log.go:44: DBG exclude_files: [] 2021/10/15 16:26:57.548495 prospector_log.go:65: INFO Prospector with previous states loaded: 0 2021/10/15 16:26:57.548485 spooler.go:63: INFO Starting spooler: spool_size: 2048; idle_timeout: 5s 2021/10/15 16:26:57.548635 prospector.go:124: INFO Starting prospector of type: log; id: 12576369028753478767 2021/10/15 16:26:57.548826 crawler.go:58: INFO Loading and starting Prospectors completed. Enabled prospectors: 1 2021/10/15 16:26:57.548936 prospector_log.go:70: DBG Start next scan 2021/10/15 16:26:57.549353 prospector_log.go:91: DBG Prospector states cleaned up. Before: 0, After: 0 2021/10/15 16:27:02.549035 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:27:07.549443 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:27:07.553028 prospector.go:183: DBG Run prospector 2021/10/15 16:27:07.553072 prospector_log.go:70: DBG Start next scan 2021/10/15 16:27:07.553355 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:07.553373 prospector_log.go:245: DBG Start harvester for new file: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:07.553503 state.go:64: DBG New state added for /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:07.553552 log.go:288: DBG Setting offset for file based on seek: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:07.553569 log.go:273: DBG Setting offset for file: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log. Offset: 0 2021/10/15 16:27:07.553599 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/15 16:27:07.553641 log.go:91: INFO Harvester started for file: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:07.553678 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:27:08.554230 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:27:10.554650 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:27:12.549813 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 1 2021/10/15 16:27:12.549948 client.go:158: DBG No events to publish 2021/10/15 16:27:12.549969 sync.go:70: DBG Events sent: 1 2021/10/15 16:27:12.550011 registrar.go:275: DBG Processing 1 events 2021/10/15 16:27:12.550026 state.go:64: DBG New state added for /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:12.550039 registrar.go:261: DBG Registrar states cleaned up. Before: 1, After: 1 2021/10/15 16:27:12.550049 registrar.go:298: DBG Write registry file: /usr/share/filebeat/data/registry 2021/10/15 16:27:13.035694 registrar.go:323: DBG Registry file updated. 1 states written. 2021/10/15 16:27:14.555048 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:27:17.550252 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:27:17.553917 prospector.go:183: DBG Run prospector 2021/10/15 16:27:17.553952 prospector_log.go:70: DBG Start next scan 2021/10/15 16:27:17.554320 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:17.554348 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log, offset: 0 2021/10/15 16:27:17.554354 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:17.554361 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/15 16:27:22.550631 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:27:22.555398 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:27:27.338205 metrics.go:39: INFO Non-zero metrics in the last 30s: filebeat.harvester.open_files=1 filebeat.harvester.running=1 filebeat.harvester.started=1 publish.events=1 registrar.states.current=1 registrar.states.update=1 registrar.writes=2 2021/10/15 16:27:27.550959 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:27:27.554673 prospector.go:183: DBG Run prospector 2021/10/15 16:27:27.554823 prospector_log.go:70: DBG Start next scan 2021/10/15 16:27:27.555817 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:27.556040 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log, offset: 0 2021/10/15 16:27:27.556151 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:27.556346 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/15 16:27:32.551338 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:27:32.555808 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:27:37.551770 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:27:37.556921 prospector.go:183: DBG Run prospector 2021/10/15 16:27:37.557041 prospector_log.go:70: DBG Start next scan 2021/10/15 16:27:37.557496 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:37.557580 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log, offset: 0 2021/10/15 16:27:37.557633 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:37.557672 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/15 16:27:42.552138 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:27:42.556315 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:27:43.556798 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:27:45.557303 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:27:47.552618 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 3 2021/10/15 16:27:47.553519 client.go:214: DBG Publish: { "@timestamp": "2021-10-15T16:27:42.556Z", "beat": { "hostname": "s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector", "name": "s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector", "version": "5.5.0" }, "input_type": "log", "message": "org.onap.dcaegen2.services.sdk.services.common.FileReader |2021-10-15T16:27:34.484Z |ERROR |Error while reading file. Filename: /app-config/application_config.yaml |RequestID=96dad614-0c0b-4d50-ae1b-27160e967686 | | |main |", "offset": 256, "source": "/var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log", "type": "log" } 2021/10/15 16:27:47.553829 client.go:214: DBG Publish: { "@timestamp": "2021-10-15T16:27:42.556Z", "beat": { "hostname": "s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector", "name": "s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector", "version": "5.5.0" }, "input_type": "log", "message": "org.onap.dcaegen2.services.sdk.rest.services.cbs.client.impl.CbsClientConfigMap |2021-10-15T16:27:34.495Z |ERROR |Error loading configuration from configMap file: Expected a com.google.gson.JsonObject but was com.google.gson.JsonNull |RequestID=96dad614-0c0b-4d50-ae1b-27160e967686 | | |main |", "offset": 582, "source": "/var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log", "type": "log" } 2021/10/15 16:27:47.554127 client.go:214: DBG Publish: { "@timestamp": "2021-10-15T16:27:42.556Z", "beat": { "hostname": "s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector", "name": "s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector", "version": "5.5.0" }, "input_type": "log", "message": "org.onap.dcaegen2.collectors.datafile.tasks.ScheduledTasks |2021-10-15T16:27:34.794Z |WARN |No configuration loaded, skipping polling for messages | | | |pool-2-thread-1 |", "offset": 786, "source": "/var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log", "type": "log" } 2021/10/15 16:27:47.554381 output.go:109: DBG output worker: publish 3 events 2021/10/15 16:27:47.554518 sync.go:53: DBG connect 2021/10/15 16:27:47.557899 prospector.go:183: DBG Run prospector 2021/10/15 16:27:47.557930 prospector_log.go:70: DBG Start next scan 2021/10/15 16:27:47.558415 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:47.558446 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log, offset: 786 2021/10/15 16:27:47.558454 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:47.558465 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/15 16:27:47.563041 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:27:47.563066 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:27:47.563078 single.go:156: DBG send fail 2021/10/15 16:27:48.563355 sync.go:53: DBG connect 2021/10/15 16:27:48.567892 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:27:48.567936 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:27:48.567948 single.go:156: DBG send fail 2021/10/15 16:27:49.557797 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:27:50.568347 sync.go:53: DBG connect 2021/10/15 16:27:50.573408 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:27:50.573449 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:27:50.573462 single.go:156: DBG send fail 2021/10/15 16:27:52.553300 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:27:54.574844 sync.go:53: DBG connect 2021/10/15 16:27:54.587230 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:27:54.587275 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:27:54.587287 single.go:156: DBG send fail 2021/10/15 16:27:57.338151 metrics.go:39: INFO Non-zero metrics in the last 30s: libbeat.publisher.published_events=3 2021/10/15 16:27:57.553727 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:27:57.558245 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:27:57.558788 prospector.go:183: DBG Run prospector 2021/10/15 16:27:57.558899 prospector_log.go:70: DBG Start next scan 2021/10/15 16:27:57.559423 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:57.559473 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log, offset: 786 2021/10/15 16:27:57.559487 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:27:57.559500 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/15 16:28:02.554144 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:28:02.587584 sync.go:53: DBG connect 2021/10/15 16:28:02.595726 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:28:02.595774 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:28:02.595791 single.go:156: DBG send fail 2021/10/15 16:28:07.554510 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:28:07.558620 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:28:07.559762 prospector.go:183: DBG Run prospector 2021/10/15 16:28:07.559794 prospector_log.go:70: DBG Start next scan 2021/10/15 16:28:07.560223 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:28:07.560256 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log, offset: 786 2021/10/15 16:28:07.560266 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:28:07.560281 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/15 16:28:12.554862 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:28:17.555352 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:28:17.559101 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:28:17.560513 prospector.go:183: DBG Run prospector 2021/10/15 16:28:17.560536 prospector_log.go:70: DBG Start next scan 2021/10/15 16:28:17.561155 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:28:17.561190 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log, offset: 786 2021/10/15 16:28:17.561198 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:28:17.561208 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2021/10/15 16:28:18.596096 sync.go:53: DBG connect 2021/10/15 16:28:18.606174 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:28:18.606233 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2021/10/15 16:28:18.606244 single.go:156: DBG send fail 2021/10/15 16:28:22.555668 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:28:27.338153 metrics.go:34: INFO No non-zero metrics in the last 30s 2021/10/15 16:28:27.556012 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2021/10/15 16:28:27.559493 log_file.go:84: DBG End of file reached: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log; Backoff now. 2021/10/15 16:28:27.561447 prospector.go:183: DBG Run prospector 2021/10/15 16:28:27.561476 prospector_log.go:70: DBG Start next scan 2021/10/15 16:28:27.561772 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:28:27.561796 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log, offset: 786 2021/10/15 16:28:27.561801 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s32ef439ddad24ee48bd0d04efbd9df87-datafile-collector/application.log 2021/10/15 16:28:27.561808 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1