2022/03/17 11:16:37.047069 beat.go:285: INFO Home path: [/usr/share/filebeat] Config path: [/usr/share/filebeat] Data path: [/usr/share/filebeat/data] Logs path: [/usr/share/filebeat/logs] 2022/03/17 11:16:37.047167 beat.go:186: INFO Setup Beat: filebeat; Version: 5.5.0 2022/03/17 11:16:37.047191 processor.go:44: DBG Processors: 2022/03/17 11:16:37.047233 beat.go:192: DBG Initializing output plugins 2022/03/17 11:16:37.047436 logstash.go:90: INFO Max Retries set to: 3 2022/03/17 11:16:37.047590 outputs.go:108: INFO Activated logstash as output plugin. 2022/03/17 11:16:37.047626 publish.go:238: DBG Create output worker 2022/03/17 11:16:37.047758 publish.go:280: DBG No output is defined to store the topology. The server fields might not be filled. 2022/03/17 11:16:37.047857 publish.go:295: INFO Publisher name: s31522f53cf8d45d29484929f653717ef-datafile-collector 2022/03/17 11:16:37.048228 async.go:63: INFO Flush Interval set to: 1s 2022/03/17 11:16:37.048262 async.go:64: INFO Max Bulk Size set to: 2048 2022/03/17 11:16:37.048289 async.go:72: DBG create bulk processing worker (interval=1s, bulk size=2048) 2022/03/17 11:16:37.049663 metrics.go:23: INFO Metrics logging every 30s 2022/03/17 11:16:37.050727 beat.go:221: INFO filebeat start running. 2022/03/17 11:16:37.050896 registrar.go:68: INFO No registry file found under: /usr/share/filebeat/data/registry. Creating a new registry file. 2022/03/17 11:16:37.050923 registrar.go:298: DBG Write registry file: /usr/share/filebeat/data/registry 2022/03/17 11:16:37.065054 registrar.go:323: DBG Registry file updated. 0 states written. 2022/03/17 11:16:37.065246 registrar.go:106: INFO Loading registrar data from /usr/share/filebeat/data/registry 2022/03/17 11:16:37.065381 registrar.go:123: INFO States Loaded from registrar: 0 2022/03/17 11:16:37.065518 crawler.go:38: INFO Loading Prospectors: 1 2022/03/17 11:16:37.065538 registrar.go:236: INFO Starting Registrar 2022/03/17 11:16:37.065614 sync.go:41: INFO Start sending events to output 2022/03/17 11:16:37.065923 spooler.go:63: INFO Starting spooler: spool_size: 2048; idle_timeout: 5s 2022/03/17 11:16:37.065971 prospector.go:83: DBG File Configs: [/var/log/onap/*/*/*/*.log /var/log/onap/*/*/*.log /var/log/onap/*/*.log] 2022/03/17 11:16:37.066025 prospector_log.go:44: DBG exclude_files: [] 2022/03/17 11:16:37.066042 prospector_log.go:65: INFO Prospector with previous states loaded: 0 2022/03/17 11:16:37.066230 prospector.go:124: INFO Starting prospector of type: log; id: 12576369028753478767 2022/03/17 11:16:37.066288 crawler.go:58: INFO Loading and starting Prospectors completed. Enabled prospectors: 1 2022/03/17 11:16:37.066335 prospector_log.go:70: DBG Start next scan 2022/03/17 11:16:37.066934 prospector_log.go:91: DBG Prospector states cleaned up. Before: 0, After: 0 2022/03/17 11:16:42.066417 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:16:47.068762 prospector.go:183: DBG Run prospector 2022/03/17 11:16:47.068936 prospector_log.go:70: DBG Start next scan 2022/03/17 11:16:47.068764 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:16:47.069672 prospector_log.go:91: DBG Prospector states cleaned up. Before: 0, After: 0 2022/03/17 11:16:52.069301 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:16:57.069875 prospector.go:183: DBG Run prospector 2022/03/17 11:16:57.069882 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:16:57.069948 prospector_log.go:70: DBG Start next scan 2022/03/17 11:16:57.071069 prospector_log.go:91: DBG Prospector states cleaned up. Before: 0, After: 0 2022/03/17 11:17:02.071859 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:17:07.051312 metrics.go:39: INFO Non-zero metrics in the last 30s: registrar.writes=1 2022/03/17 11:17:07.071963 prospector.go:183: DBG Run prospector 2022/03/17 11:17:07.072111 prospector_log.go:70: DBG Start next scan 2022/03/17 11:17:07.072641 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:17:07.077031 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:07.077127 prospector_log.go:245: DBG Start harvester for new file: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:07.077989 state.go:64: DBG New state added for /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:07.078876 log.go:288: DBG Setting offset for file based on seek: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:07.078975 log.go:273: DBG Setting offset for file: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log. Offset: 0 2022/03/17 11:17:07.079159 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2022/03/17 11:17:07.079349 log.go:91: INFO Harvester started for file: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:07.080624 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:17:08.085658 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:17:10.087207 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:17:12.073765 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 1 2022/03/17 11:17:12.073866 client.go:158: DBG No events to publish 2022/03/17 11:17:12.073882 sync.go:70: DBG Events sent: 1 2022/03/17 11:17:12.073896 registrar.go:275: DBG Processing 1 events 2022/03/17 11:17:12.073921 state.go:64: DBG New state added for /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:12.074234 registrar.go:261: DBG Registrar states cleaned up. Before: 1, After: 1 2022/03/17 11:17:12.074507 registrar.go:298: DBG Write registry file: /usr/share/filebeat/data/registry 2022/03/17 11:17:12.080814 registrar.go:323: DBG Registry file updated. 1 states written. 2022/03/17 11:17:14.087701 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:17:17.074611 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:17:17.080418 prospector.go:183: DBG Run prospector 2022/03/17 11:17:17.080510 prospector_log.go:70: DBG Start next scan 2022/03/17 11:17:17.081584 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:17.081638 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log, offset: 0 2022/03/17 11:17:17.081657 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:17.081675 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2022/03/17 11:17:22.075011 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:17:22.088448 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:17:27.077849 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:17:27.082301 prospector.go:183: DBG Run prospector 2022/03/17 11:17:27.082399 prospector_log.go:70: DBG Start next scan 2022/03/17 11:17:27.084745 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:27.084851 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log, offset: 0 2022/03/17 11:17:27.084927 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:27.084950 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2022/03/17 11:17:32.078258 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:17:32.089227 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:17:37.050560 metrics.go:39: INFO Non-zero metrics in the last 30s: filebeat.harvester.open_files=1 filebeat.harvester.running=1 filebeat.harvester.started=1 publish.events=1 registrar.states.current=1 registrar.states.update=1 registrar.writes=1 2022/03/17 11:17:37.078657 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:17:37.086102 prospector.go:183: DBG Run prospector 2022/03/17 11:17:37.086958 prospector_log.go:70: DBG Start next scan 2022/03/17 11:17:37.087932 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:37.088151 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log, offset: 0 2022/03/17 11:17:37.088181 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:37.088201 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2022/03/17 11:17:42.078967 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:17:42.101233 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:17:47.086620 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:17:47.090738 prospector.go:183: DBG Run prospector 2022/03/17 11:17:47.090998 prospector_log.go:70: DBG Start next scan 2022/03/17 11:17:47.095318 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:47.095424 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log, offset: 0 2022/03/17 11:17:47.095578 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:47.095601 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2022/03/17 11:17:52.088799 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:17:52.103970 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:17:57.089156 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:17:57.099102 prospector.go:183: DBG Run prospector 2022/03/17 11:17:57.099177 prospector_log.go:70: DBG Start next scan 2022/03/17 11:17:57.099704 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:57.099738 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log, offset: 0 2022/03/17 11:17:57.099747 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:17:57.099756 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2022/03/17 11:18:02.098639 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:18:02.107772 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:18:07.050364 metrics.go:34: INFO No non-zero metrics in the last 30s 2022/03/17 11:18:07.104261 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:18:07.104554 prospector.go:183: DBG Run prospector 2022/03/17 11:18:07.104603 prospector_log.go:70: DBG Start next scan 2022/03/17 11:18:07.105155 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:18:07.105185 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log, offset: 0 2022/03/17 11:18:07.105202 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:18:07.105213 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2022/03/17 11:18:12.104576 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:18:12.122481 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:18:17.105407 prospector.go:183: DBG Run prospector 2022/03/17 11:18:17.105453 prospector_log.go:70: DBG Start next scan 2022/03/17 11:18:17.106164 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:18:17.106191 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log, offset: 0 2022/03/17 11:18:17.106202 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:18:17.106214 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2022/03/17 11:18:17.106470 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:18:22.106754 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:18:22.132427 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:18:23.142687 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:18:25.143425 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:18:27.106677 prospector.go:183: DBG Run prospector 2022/03/17 11:18:27.106742 prospector_log.go:70: DBG Start next scan 2022/03/17 11:18:27.108637 prospector_log.go:226: DBG Check file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:18:27.108686 prospector_log.go:259: DBG Update existing file for harvesting: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log, offset: 786 2022/03/17 11:18:27.108705 prospector_log.go:311: DBG Harvester for file is still running: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log 2022/03/17 11:18:27.108742 prospector_log.go:91: DBG Prospector states cleaned up. Before: 1, After: 1 2022/03/17 11:18:27.109049 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 3 2022/03/17 11:18:27.109622 client.go:214: DBG Publish: { "@timestamp": "2022-03-17T11:18:22.132Z", "beat": { "hostname": "s31522f53cf8d45d29484929f653717ef-datafile-collector", "name": "s31522f53cf8d45d29484929f653717ef-datafile-collector", "version": "5.5.0" }, "input_type": "log", "message": "org.onap.dcaegen2.services.sdk.services.common.FileReader |2022-03-17T11:18:16.729Z |ERROR |Error while reading file. Filename: /app-config/application_config.yaml |RequestID=5937be6d-552a-43e1-9d00-6679272dec6e | | |main |", "offset": 256, "source": "/var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log", "type": "log" } 2022/03/17 11:18:27.109775 client.go:214: DBG Publish: { "@timestamp": "2022-03-17T11:18:22.132Z", "beat": { "hostname": "s31522f53cf8d45d29484929f653717ef-datafile-collector", "name": "s31522f53cf8d45d29484929f653717ef-datafile-collector", "version": "5.5.0" }, "input_type": "log", "message": "org.onap.dcaegen2.services.sdk.rest.services.cbs.client.impl.CbsClientConfigMap |2022-03-17T11:18:16.803Z |ERROR |Error loading configuration from configMap file: Expected a com.google.gson.JsonObject but was com.google.gson.JsonNull |RequestID=5937be6d-552a-43e1-9d00-6679272dec6e | | |main |", "offset": 582, "source": "/var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log", "type": "log" } 2022/03/17 11:18:27.110011 client.go:214: DBG Publish: { "@timestamp": "2022-03-17T11:18:22.132Z", "beat": { "hostname": "s31522f53cf8d45d29484929f653717ef-datafile-collector", "name": "s31522f53cf8d45d29484929f653717ef-datafile-collector", "version": "5.5.0" }, "input_type": "log", "message": "org.onap.dcaegen2.collectors.datafile.tasks.ScheduledTasks |2022-03-17T11:18:17.214Z |WARN |No configuration loaded, skipping polling for messages | | | |pool-2-thread-1 |", "offset": 786, "source": "/var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log", "type": "log" } 2022/03/17 11:18:27.110091 output.go:109: DBG output worker: publish 3 events 2022/03/17 11:18:27.110127 sync.go:53: DBG connect 2022/03/17 11:18:27.149852 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2022/03/17 11:18:27.150012 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2022/03/17 11:18:27.150042 single.go:156: DBG send fail 2022/03/17 11:18:28.150305 sync.go:53: DBG connect 2022/03/17 11:18:28.156104 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2022/03/17 11:18:28.156157 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2022/03/17 11:18:28.156175 single.go:156: DBG send fail 2022/03/17 11:18:29.145986 log_file.go:84: DBG End of file reached: /var/log/onap/s31522f53cf8d45d29484929f653717ef-datafile-collector/application.log; Backoff now. 2022/03/17 11:18:30.156521 sync.go:53: DBG connect 2022/03/17 11:18:30.186804 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2022/03/17 11:18:30.186885 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2022/03/17 11:18:30.186906 single.go:156: DBG send fail 2022/03/17 11:18:32.109590 spooler.go:89: DBG Flushing spooler because of timeout. Events flushed: 0 2022/03/17 11:18:34.188099 sync.go:53: DBG connect 2022/03/17 11:18:34.217227 tcp.go:26: WARN DNS lookup failure "log-ls.onap": lookup log-ls.onap on 169.254.25.10:53: no such host 2022/03/17 11:18:34.217286 single.go:140: ERR Connecting error publishing events (retrying): lookup log-ls.onap on 169.254.25.10:53: no such host 2022/03/17 11:18:34.217305 single.go:156: DBG send fail